2023-11-18 00:53:13,553 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-18 00:53:13,798 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371 2023-11-18 00:53:13,814 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-18 00:53:13,815 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/cluster_8c545dd1-5e13-fa17-ac7b-07a423d1c876, deleteOnExit=true 2023-11-18 00:53:13,815 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-18 00:53:13,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/test.cache.data in system properties and HBase conf 2023-11-18 00:53:13,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/hadoop.tmp.dir in system properties and HBase conf 2023-11-18 00:53:13,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/hadoop.log.dir in system properties and HBase conf 2023-11-18 00:53:13,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-18 00:53:13,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-18 00:53:13,818 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-18 00:53:13,946 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-18 00:53:14,356 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-18 00:53:14,361 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-18 00:53:14,361 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-18 00:53:14,362 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-18 00:53:14,362 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-18 00:53:14,362 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-18 00:53:14,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-18 00:53:14,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-18 00:53:14,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-18 00:53:14,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-18 00:53:14,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/nfs.dump.dir in system properties and HBase conf 2023-11-18 00:53:14,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/java.io.tmpdir in system properties and HBase conf 2023-11-18 00:53:14,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-18 00:53:14,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-18 00:53:14,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-18 00:53:14,976 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-18 00:53:14,981 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-18 00:53:15,274 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-18 00:53:15,452 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-18 00:53:15,468 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-18 00:53:15,504 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-18 00:53:15,537 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/java.io.tmpdir/Jetty_localhost_37097_hdfs____.w2xtkc/webapp 2023-11-18 00:53:15,696 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37097 2023-11-18 00:53:15,708 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-18 00:53:15,708 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-18 00:53:16,246 WARN [Listener at localhost/40865] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-18 00:53:16,356 WARN [Listener at localhost/40865] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-18 00:53:16,376 WARN [Listener at localhost/40865] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-18 00:53:16,383 INFO [Listener at localhost/40865] log.Slf4jLog(67): jetty-6.1.26 2023-11-18 00:53:16,390 INFO [Listener at localhost/40865] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/java.io.tmpdir/Jetty_localhost_37757_datanode____ueprx8/webapp 2023-11-18 00:53:16,524 INFO [Listener at localhost/40865] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37757 2023-11-18 00:53:16,897 WARN [Listener at localhost/41175] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-18 00:53:17,468 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xee2f277fc5d247af: Processing first storage report for DS-c8f6c908-494a-495c-91f2-53687392e234 from datanode d1b3c53f-7c3b-4aa8-a0d5-78d0e40801bb 2023-11-18 00:53:17,470 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xee2f277fc5d247af: from storage DS-c8f6c908-494a-495c-91f2-53687392e234 node DatanodeRegistration(127.0.0.1:46471, datanodeUuid=d1b3c53f-7c3b-4aa8-a0d5-78d0e40801bb, infoPort=34601, infoSecurePort=0, ipcPort=41175, storageInfo=lv=-57;cid=testClusterID;nsid=1651580576;c=1700268795059), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-18 00:53:17,470 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xee2f277fc5d247af: Processing first storage report for DS-074029fe-777c-41ce-94c4-132e8d3add09 from datanode d1b3c53f-7c3b-4aa8-a0d5-78d0e40801bb 2023-11-18 00:53:17,470 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xee2f277fc5d247af: from storage DS-074029fe-777c-41ce-94c4-132e8d3add09 node DatanodeRegistration(127.0.0.1:46471, datanodeUuid=d1b3c53f-7c3b-4aa8-a0d5-78d0e40801bb, infoPort=34601, infoSecurePort=0, ipcPort=41175, storageInfo=lv=-57;cid=testClusterID;nsid=1651580576;c=1700268795059), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-18 00:53:17,506 DEBUG [Listener at localhost/41175] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371 2023-11-18 00:53:17,634 INFO [Listener at localhost/41175] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/cluster_8c545dd1-5e13-fa17-ac7b-07a423d1c876/zookeeper_0, clientPort=58527, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/cluster_8c545dd1-5e13-fa17-ac7b-07a423d1c876/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/cluster_8c545dd1-5e13-fa17-ac7b-07a423d1c876/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-18 00:53:17,650 INFO [Listener at localhost/41175] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58527 2023-11-18 00:53:17,657 INFO [Listener at localhost/41175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:53:17,660 INFO [Listener at localhost/41175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:53:18,339 INFO [Listener at localhost/41175] util.FSUtils(471): Created version file at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab with version=8 2023-11-18 00:53:18,340 INFO [Listener at localhost/41175] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/hbase-staging 2023-11-18 00:53:18,631 INFO [Listener at localhost/41175] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-18 00:53:19,121 INFO [Listener at localhost/41175] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-18 00:53:19,156 INFO [Listener at localhost/41175] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-18 00:53:19,156 INFO [Listener at localhost/41175] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-18 00:53:19,157 INFO [Listener at localhost/41175] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-18 00:53:19,157 INFO [Listener at localhost/41175] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-18 00:53:19,157 INFO [Listener at localhost/41175] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-18 00:53:19,308 INFO [Listener at localhost/41175] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-18 00:53:19,389 DEBUG [Listener at localhost/41175] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-18 00:53:19,509 INFO [Listener at localhost/41175] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38477 2023-11-18 00:53:19,519 INFO [Listener at localhost/41175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:53:19,521 INFO [Listener at localhost/41175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:53:19,543 INFO [Listener at localhost/41175] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38477 connecting to ZooKeeper ensemble=127.0.0.1:58527 2023-11-18 00:53:19,588 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:384770x0, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-18 00:53:19,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38477-0x101f6aa264f0000 connected 2023-11-18 00:53:19,625 DEBUG [Listener at localhost/41175] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-18 00:53:19,626 DEBUG [Listener at localhost/41175] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-18 00:53:19,630 DEBUG [Listener at localhost/41175] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-18 00:53:19,638 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38477 2023-11-18 00:53:19,638 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38477 2023-11-18 00:53:19,639 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38477 2023-11-18 00:53:19,639 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38477 2023-11-18 00:53:19,640 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38477 2023-11-18 00:53:19,645 INFO [Listener at localhost/41175] master.HMaster(444): hbase.rootdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab, hbase.cluster.distributed=false 2023-11-18 00:53:19,712 INFO [Listener at localhost/41175] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-18 00:53:19,712 INFO [Listener at localhost/41175] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-18 00:53:19,712 INFO [Listener at localhost/41175] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-18 00:53:19,712 INFO [Listener at localhost/41175] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-18 00:53:19,713 INFO [Listener at localhost/41175] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-18 00:53:19,713 INFO [Listener at localhost/41175] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-18 00:53:19,718 INFO [Listener at localhost/41175] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-18 00:53:19,721 INFO [Listener at localhost/41175] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46287 2023-11-18 00:53:19,724 INFO [Listener at localhost/41175] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-18 00:53:19,733 DEBUG [Listener at localhost/41175] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-18 00:53:19,734 INFO [Listener at localhost/41175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:53:19,738 INFO [Listener at localhost/41175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:53:19,741 INFO [Listener at localhost/41175] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46287 connecting to ZooKeeper ensemble=127.0.0.1:58527 2023-11-18 00:53:19,746 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:462870x0, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-18 00:53:19,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46287-0x101f6aa264f0001 connected 2023-11-18 00:53:19,747 DEBUG [Listener at localhost/41175] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-18 00:53:19,748 DEBUG [Listener at localhost/41175] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-18 00:53:19,749 DEBUG [Listener at localhost/41175] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-18 00:53:19,753 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46287 2023-11-18 00:53:19,753 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46287 2023-11-18 00:53:19,753 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46287 2023-11-18 00:53:19,755 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46287 2023-11-18 00:53:19,755 DEBUG [Listener at localhost/41175] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46287 2023-11-18 00:53:19,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:53:19,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-18 00:53:19,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:53:19,788 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-18 00:53:19,788 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-18 00:53:19,788 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:53:19,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-18 00:53:19,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38477,1700268798477 from backup master directory 2023-11-18 00:53:19,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-18 00:53:19,794 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:53:19,794 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-18 00:53:19,795 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-18 00:53:19,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:53:19,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-18 00:53:19,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-18 00:53:19,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/hbase.id with ID: 55300c38-e173-4f3b-be56-f0b607a605cc 2023-11-18 00:53:19,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:53:19,945 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:53:19,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x748154db to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:53:20,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@713a24b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:53:20,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-18 00:53:20,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-18 00:53:20,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-18 00:53:20,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-18 00:53:20,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-18 00:53:20,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-18 00:53:20,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-18 00:53:20,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store-tmp 2023-11-18 00:53:20,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:20,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-18 00:53:20,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 00:53:20,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 00:53:20,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-18 00:53:20,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 00:53:20,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 00:53:20,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-18 00:53:20,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/WALs/jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:53:20,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38477%2C1700268798477, suffix=, logDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/WALs/jenkins-hbase4.apache.org,38477,1700268798477, archiveDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/oldWALs, maxLogs=10 2023-11-18 00:53:20,225 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46471,DS-c8f6c908-494a-495c-91f2-53687392e234,DISK] 2023-11-18 00:53:20,233 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-18 00:53:20,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/WALs/jenkins-hbase4.apache.org,38477,1700268798477/jenkins-hbase4.apache.org%2C38477%2C1700268798477.1700268800164 2023-11-18 00:53:20,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46471,DS-c8f6c908-494a-495c-91f2-53687392e234,DISK]] 2023-11-18 00:53:20,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:53:20,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:20,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-18 00:53:20,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-18 00:53:20,378 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-18 00:53:20,386 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-18 00:53:20,413 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-18 00:53:20,425 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:20,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-18 00:53:20,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-18 00:53:20,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-18 00:53:20,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:53:20,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68447610, jitterRate=0.019948869943618774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:53:20,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-18 00:53:20,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-18 00:53:20,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-18 00:53:20,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-18 00:53:20,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-18 00:53:20,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-18 00:53:20,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-11-18 00:53:20,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-18 00:53:20,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-18 00:53:20,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-18 00:53:20,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-18 00:53:20,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-18 00:53:20,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-18 00:53:20,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-18 00:53:20,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-18 00:53:20,608 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:53:20,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-18 00:53:20,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-18 00:53:20,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-18 00:53:20,628 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-18 00:53:20,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-18 00:53:20,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:53:20,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38477,1700268798477, sessionid=0x101f6aa264f0000, setting cluster-up flag (Was=false) 2023-11-18 00:53:20,648 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:53:20,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-18 00:53:20,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:53:20,662 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:53:20,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-18 00:53:20,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:53:20,672 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp 2023-11-18 00:53:20,760 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(951): ClusterId : 55300c38-e173-4f3b-be56-f0b607a605cc 2023-11-18 00:53:20,766 DEBUG [RS:0;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-18 00:53:20,772 DEBUG [RS:0;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-18 00:53:20,773 DEBUG [RS:0;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-18 00:53:20,776 DEBUG [RS:0;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-18 00:53:20,779 DEBUG [RS:0;jenkins-hbase4:46287] zookeeper.ReadOnlyZKClient(139): Connect 0x3605bbb4 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:53:20,787 DEBUG [RS:0;jenkins-hbase4:46287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38c24304, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:53:20,788 DEBUG [RS:0;jenkins-hbase4:46287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cfdd0c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-18 00:53:20,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-18 00:53:20,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-18 00:53:20,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-18 00:53:20,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-18 00:53:20,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-18 00:53:20,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-18 00:53:20,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:20,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-18 00:53:20,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:20,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1700268830813 2023-11-18 00:53:20,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-18 00:53:20,819 DEBUG [RS:0;jenkins-hbase4:46287] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46287 2023-11-18 00:53:20,821 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-18 00:53:20,821 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-18 00:53:20,823 INFO [RS:0;jenkins-hbase4:46287] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-18 00:53:20,823 INFO [RS:0;jenkins-hbase4:46287] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-18 00:53:20,823 DEBUG [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1022): About to register with Master. 2023-11-18 00:53:20,827 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38477,1700268798477 with isa=jenkins-hbase4.apache.org/172.31.14.131:46287, startcode=1700268799711 2023-11-18 00:53:20,827 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-18 00:53:20,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-18 00:53:20,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-18 00:53:20,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-18 00:53:20,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-18 00:53:20,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-18 00:53:20,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:20,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-18 00:53:20,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-18 00:53:20,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-18 00:53:20,847 DEBUG [RS:0;jenkins-hbase4:46287] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-18 00:53:20,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-18 00:53:20,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-18 00:53:20,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700268800852,5,FailOnTimeoutGroup] 2023-11-18 00:53:20,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700268800852,5,FailOnTimeoutGroup] 2023-11-18 00:53:20,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:20,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-18 00:53:20,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:20,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:20,867 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-18 00:53:20,868 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-18 00:53:20,869 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab 2023-11-18 00:53:20,889 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:20,892 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-18 00:53:20,896 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/info 2023-11-18 00:53:20,898 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-18 00:53:20,899 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:20,900 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-18 00:53:20,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/rep_barrier 2023-11-18 00:53:20,905 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-18 00:53:20,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:20,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-18 00:53:20,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/table 2023-11-18 00:53:20,909 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-18 00:53:20,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:20,912 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740 2023-11-18 00:53:20,913 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740 2023-11-18 00:53:20,917 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45145, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-18 00:53:20,917 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-18 00:53:20,919 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-18 00:53:20,925 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:53:20,927 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62352408, jitterRate=-0.07087671756744385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-18 00:53:20,927 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-18 00:53:20,927 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-18 00:53:20,927 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-18 00:53:20,927 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-18 00:53:20,927 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-18 00:53:20,927 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-18 00:53:20,929 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38477] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:20,929 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-18 00:53:20,929 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-18 00:53:20,935 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-18 00:53:20,935 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-18 00:53:20,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-18 00:53:20,950 DEBUG [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab 2023-11-18 00:53:20,950 DEBUG [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40865 2023-11-18 00:53:20,950 DEBUG [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-18 00:53:20,955 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-18 00:53:20,957 DEBUG [RS:0;jenkins-hbase4:46287] zookeeper.ZKUtil(162): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:20,957 WARN [RS:0;jenkins-hbase4:46287] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-18 00:53:20,957 INFO [RS:0;jenkins-hbase4:46287] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-18 00:53:20,958 DEBUG [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/WALs/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:20,959 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46287,1700268799711] 2023-11-18 00:53:20,964 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-18 00:53:20,969 DEBUG [RS:0;jenkins-hbase4:46287] zookeeper.ZKUtil(162): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:20,970 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-18 00:53:20,981 DEBUG [RS:0;jenkins-hbase4:46287] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-18 00:53:20,989 INFO [RS:0;jenkins-hbase4:46287] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-18 00:53:21,008 INFO [RS:0;jenkins-hbase4:46287] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-18 00:53:21,011 INFO [RS:0;jenkins-hbase4:46287] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:53:21,012 INFO [RS:0;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,013 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-18 00:53:21,020 INFO [RS:0;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,021 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,021 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,021 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,021 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,022 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,022 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-18 00:53:21,022 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,022 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,022 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,023 DEBUG [RS:0;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 00:53:21,024 INFO [RS:0;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,024 INFO [RS:0;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,024 INFO [RS:0;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,045 INFO [RS:0;jenkins-hbase4:46287] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-18 00:53:21,048 INFO [RS:0;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46287,1700268799711-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,063 INFO [RS:0;jenkins-hbase4:46287] regionserver.Replication(203): jenkins-hbase4.apache.org,46287,1700268799711 started 2023-11-18 00:53:21,063 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46287,1700268799711, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46287, sessionid=0x101f6aa264f0001 2023-11-18 00:53:21,064 DEBUG [RS:0;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-18 00:53:21,064 DEBUG [RS:0;jenkins-hbase4:46287] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:21,064 DEBUG [RS:0;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46287,1700268799711' 2023-11-18 00:53:21,064 DEBUG [RS:0;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:21,065 DEBUG [RS:0;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:21,065 DEBUG [RS:0;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-18 00:53:21,065 DEBUG [RS:0;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-18 00:53:21,065 DEBUG [RS:0;jenkins-hbase4:46287] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:21,066 DEBUG [RS:0;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46287,1700268799711' 2023-11-18 00:53:21,066 DEBUG [RS:0;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-18 00:53:21,066 DEBUG [RS:0;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-18 00:53:21,067 DEBUG [RS:0;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-18 00:53:21,067 INFO [RS:0;jenkins-hbase4:46287] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-18 00:53:21,067 INFO [RS:0;jenkins-hbase4:46287] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-18 00:53:21,122 DEBUG [jenkins-hbase4:38477] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-18 00:53:21,124 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46287,1700268799711, state=OPENING 2023-11-18 00:53:21,131 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-18 00:53:21,133 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:53:21,134 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-18 00:53:21,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:53:21,179 INFO [RS:0;jenkins-hbase4:46287] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46287%2C1700268799711, suffix=, logDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/WALs/jenkins-hbase4.apache.org,46287,1700268799711, archiveDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/oldWALs, maxLogs=32 2023-11-18 00:53:21,204 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46471,DS-c8f6c908-494a-495c-91f2-53687392e234,DISK] 2023-11-18 00:53:21,208 INFO [RS:0;jenkins-hbase4:46287] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/WALs/jenkins-hbase4.apache.org,46287,1700268799711/jenkins-hbase4.apache.org%2C46287%2C1700268799711.1700268801184 2023-11-18 00:53:21,208 DEBUG [RS:0;jenkins-hbase4:46287] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46471,DS-c8f6c908-494a-495c-91f2-53687392e234,DISK]] 2023-11-18 00:53:21,326 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:21,329 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-18 00:53:21,333 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-18 00:53:21,351 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-18 00:53:21,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-18 00:53:21,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46287%2C1700268799711.meta, suffix=.meta, logDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/WALs/jenkins-hbase4.apache.org,46287,1700268799711, archiveDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/oldWALs, maxLogs=32 2023-11-18 00:53:21,378 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46471,DS-c8f6c908-494a-495c-91f2-53687392e234,DISK] 2023-11-18 00:53:21,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/WALs/jenkins-hbase4.apache.org,46287,1700268799711/jenkins-hbase4.apache.org%2C46287%2C1700268799711.meta.1700268801358.meta 2023-11-18 00:53:21,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46471,DS-c8f6c908-494a-495c-91f2-53687392e234,DISK]] 2023-11-18 00:53:21,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:53:21,386 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-18 00:53:21,407 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-18 00:53:21,413 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-18 00:53:21,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-18 00:53:21,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:21,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-18 00:53:21,421 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-18 00:53:21,425 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-18 00:53:21,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/info 2023-11-18 00:53:21,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/info 2023-11-18 00:53:21,428 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-18 00:53:21,429 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:21,429 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-18 00:53:21,431 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/rep_barrier 2023-11-18 00:53:21,431 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/rep_barrier 2023-11-18 00:53:21,431 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-18 00:53:21,432 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:21,433 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-18 00:53:21,434 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/table 2023-11-18 00:53:21,434 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/table 2023-11-18 00:53:21,435 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-18 00:53:21,436 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:21,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740 2023-11-18 00:53:21,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740 2023-11-18 00:53:21,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-18 00:53:21,451 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-18 00:53:21,453 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63784032, jitterRate=-0.04954385757446289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-18 00:53:21,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-18 00:53:21,463 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1700268801316 2023-11-18 00:53:21,482 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-18 00:53:21,483 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-18 00:53:21,483 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46287,1700268799711, state=OPEN 2023-11-18 00:53:21,490 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-18 00:53:21,490 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-18 00:53:21,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-18 00:53:21,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46287,1700268799711 in 353 msec 2023-11-18 00:53:21,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-18 00:53:21,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 551 msec 2023-11-18 00:53:21,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 781 msec 2023-11-18 00:53:21,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1700268801509, completionTime=-1 2023-11-18 00:53:21,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-18 00:53:21,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-18 00:53:21,589 DEBUG [hconnection-0x641b6321-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:53:21,594 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:53:21,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-18 00:53:21,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1700268861614 2023-11-18 00:53:21,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1700268921614 2023-11-18 00:53:21,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 104 msec 2023-11-18 00:53:21,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38477,1700268798477-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38477,1700268798477-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38477,1700268798477-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38477, period=300000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-18 00:53:21,656 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-18 00:53:21,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-18 00:53:21,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-18 00:53:21,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-18 00:53:21,687 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:53:21,690 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:53:21,711 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/hbase/namespace/d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:21,713 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/hbase/namespace/d58ab55def45369c725fc2db46bed884 empty. 2023-11-18 00:53:21,714 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/hbase/namespace/d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:21,714 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-18 00:53:22,135 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-18 00:53:22,138 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d58ab55def45369c725fc2db46bed884, NAME => 'hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:53:22,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:22,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d58ab55def45369c725fc2db46bed884, disabling compactions & flushes 2023-11-18 00:53:22,552 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:53:22,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:53:22,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. after waiting 0 ms 2023-11-18 00:53:22,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:53:22,552 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:53:22,552 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d58ab55def45369c725fc2db46bed884: 2023-11-18 00:53:22,557 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:53:22,572 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700268802560"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268802560"}]},"ts":"1700268802560"} 2023-11-18 00:53:22,599 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:53:22,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:53:22,605 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268802601"}]},"ts":"1700268802601"} 2023-11-18 00:53:22,608 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-18 00:53:22,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d58ab55def45369c725fc2db46bed884, ASSIGN}] 2023-11-18 00:53:22,618 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d58ab55def45369c725fc2db46bed884, ASSIGN 2023-11-18 00:53:22,620 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d58ab55def45369c725fc2db46bed884, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:53:22,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d58ab55def45369c725fc2db46bed884, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:22,771 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700268802770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268802770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268802770"}]},"ts":"1700268802770"} 2023-11-18 00:53:22,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d58ab55def45369c725fc2db46bed884, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:53:22,929 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:22,936 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:53:22,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d58ab55def45369c725fc2db46bed884, NAME => 'hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:53:22,937 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:22,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:22,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:22,938 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:22,941 INFO [StoreOpener-d58ab55def45369c725fc2db46bed884-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:22,944 DEBUG [StoreOpener-d58ab55def45369c725fc2db46bed884-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884/info 2023-11-18 00:53:22,944 DEBUG [StoreOpener-d58ab55def45369c725fc2db46bed884-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884/info 2023-11-18 00:53:22,945 INFO [StoreOpener-d58ab55def45369c725fc2db46bed884-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d58ab55def45369c725fc2db46bed884 columnFamilyName info 2023-11-18 00:53:22,946 INFO [StoreOpener-d58ab55def45369c725fc2db46bed884-1] regionserver.HStore(310): Store=d58ab55def45369c725fc2db46bed884/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:22,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:22,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:22,954 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d58ab55def45369c725fc2db46bed884 2023-11-18 00:53:22,960 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:53:22,961 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d58ab55def45369c725fc2db46bed884; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70406683, jitterRate=0.049141332507133484}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:53:22,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d58ab55def45369c725fc2db46bed884: 2023-11-18 00:53:22,963 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884., pid=6, masterSystemTime=1700268802929 2023-11-18 00:53:22,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:53:22,968 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:53:22,970 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d58ab55def45369c725fc2db46bed884, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:22,971 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700268802970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268802970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268802970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268802970"}]},"ts":"1700268802970"} 2023-11-18 00:53:22,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-18 00:53:22,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d58ab55def45369c725fc2db46bed884, server=jenkins-hbase4.apache.org,46287,1700268799711 in 200 msec 2023-11-18 00:53:22,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-18 00:53:22,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d58ab55def45369c725fc2db46bed884, ASSIGN in 365 msec 2023-11-18 00:53:22,987 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:53:22,988 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268802988"}]},"ts":"1700268802988"} 2023-11-18 00:53:22,992 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-18 00:53:22,996 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:53:23,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3200 sec 2023-11-18 00:53:23,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-18 00:53:23,091 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-18 00:53:23,091 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:53:23,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-18 00:53:23,145 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-18 00:53:23,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-11-18 00:53:23,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-18 00:53:23,175 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-18 00:53:23,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-11-18 00:53:23,189 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-18 00:53:23,192 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-18 00:53:23,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.397sec 2023-11-18 00:53:23,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-18 00:53:23,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-18 00:53:23,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-18 00:53:23,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38477,1700268798477-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-18 00:53:23,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38477,1700268798477-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-18 00:53:23,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-18 00:53:23,267 DEBUG [Listener at localhost/41175] zookeeper.ReadOnlyZKClient(139): Connect 0x2324da13 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:53:23,273 DEBUG [Listener at localhost/41175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@438af03d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:53:23,293 DEBUG [hconnection-0x296ad028-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:53:23,308 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:53:23,318 INFO [Listener at localhost/41175] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:53:23,320 DEBUG [Listener at localhost/41175] zookeeper.ReadOnlyZKClient(139): Connect 0x05ae2dad to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:53:23,325 DEBUG [Listener at localhost/41175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e8f0a32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:53:23,325 INFO [Listener at localhost/41175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:53:23,381 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=277, ProcessCount=171, AvailableMemoryMB=9906 2023-11-18 00:53:23,391 DEBUG [Listener at localhost/41175] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:53:23,394 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:53:23,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 00:53:23,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:23,410 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:53:23,412 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:53:23,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-18 00:53:23,414 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:23,416 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3 empty. 2023-11-18 00:53:23,418 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:23,418 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-18 00:53:23,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 00:53:23,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 00:53:23,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 00:53:23,835 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-18 00:53:23,838 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => f60a03911e1e030bc0df0fdae03cbef3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:53:23,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:23,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing f60a03911e1e030bc0df0fdae03cbef3, disabling compactions & flushes 2023-11-18 00:53:23,852 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:23,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:23,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. after waiting 0 ms 2023-11-18 00:53:23,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:23,852 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:23,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:23,857 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:53:23,859 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700268803859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268803859"}]},"ts":"1700268803859"} 2023-11-18 00:53:23,862 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:53:23,863 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:53:23,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268803863"}]},"ts":"1700268803863"} 2023-11-18 00:53:23,865 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-18 00:53:23,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f60a03911e1e030bc0df0fdae03cbef3, ASSIGN}] 2023-11-18 00:53:23,872 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f60a03911e1e030bc0df0fdae03cbef3, ASSIGN 2023-11-18 00:53:23,874 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f60a03911e1e030bc0df0fdae03cbef3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:53:24,025 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f60a03911e1e030bc0df0fdae03cbef3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:24,026 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700268804025"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268804025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268804025"}]},"ts":"1700268804025"} 2023-11-18 00:53:24,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f60a03911e1e030bc0df0fdae03cbef3, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:53:24,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 00:53:24,182 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:24,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:24,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f60a03911e1e030bc0df0fdae03cbef3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:53:24,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:24,194 INFO [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:24,197 DEBUG [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:24,197 DEBUG [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:24,200 INFO [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f60a03911e1e030bc0df0fdae03cbef3 columnFamilyName family1 2023-11-18 00:53:24,204 INFO [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] regionserver.HStore(310): Store=f60a03911e1e030bc0df0fdae03cbef3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:24,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:24,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:24,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:24,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:53:24,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f60a03911e1e030bc0df0fdae03cbef3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59701972, jitterRate=-0.11037129163742065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:53:24,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:24,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3., pid=11, masterSystemTime=1700268804182 2023-11-18 00:53:24,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:24,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:24,235 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f60a03911e1e030bc0df0fdae03cbef3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:24,235 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700268804235"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268804235"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268804235"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268804235"}]},"ts":"1700268804235"} 2023-11-18 00:53:24,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-18 00:53:24,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f60a03911e1e030bc0df0fdae03cbef3, server=jenkins-hbase4.apache.org,46287,1700268799711 in 210 msec 2023-11-18 00:53:24,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-18 00:53:24,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f60a03911e1e030bc0df0fdae03cbef3, ASSIGN in 373 msec 2023-11-18 00:53:24,248 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:53:24,248 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268804248"}]},"ts":"1700268804248"} 2023-11-18 00:53:24,252 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-18 00:53:24,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:53:24,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 850 msec 2023-11-18 00:53:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 00:53:24,535 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-18 00:53:24,552 DEBUG [hconnection-0x7e3e3678-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:53:24,554 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:53:24,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:24,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:24,722 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:24,722 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:24,722 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:24,722 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:24,723 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:24,723 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:24,726 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:24,726 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:24,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:24,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:24,727 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:24,727 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:24,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:24,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:24,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:24,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:24,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:24,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:24,731 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:24,731 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:24,732 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:24,732 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:24,732 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:24,733 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:24,733 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:24,734 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 00:53:25,294 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e6625ab1dd5f4e878daf1d2380f14ab2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e6625ab1dd5f4e878daf1d2380f14ab2 2023-11-18 00:53:25,709 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/971229f668f44063b36e593f4b5a0ed5 2023-11-18 00:53:25,726 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/971229f668f44063b36e593f4b5a0ed5 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/971229f668f44063b36e593f4b5a0ed5 2023-11-18 00:53:25,744 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/971229f668f44063b36e593f4b5a0ed5, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-18 00:53:25,751 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 1017ms, sequenceid=5, compaction requested=false 2023-11-18 00:53:25,752 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:25,755 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:25,756 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:25,756 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:25,757 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:25,757 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,757 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:25,757 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:25,761 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:25,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:25,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:25,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:25,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:25,767 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:25,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@795f240d[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:25,767 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,770 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:25,770 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:25,770 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:25,770 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,770 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:25,774 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:25,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:25,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:25,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:25,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:25,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:25,779 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:25,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:25,779 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:25,779 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:25,779 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,779 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:25,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:25,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:25,784 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:25,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,786 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,796 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,796 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:25,796 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:25,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:25,797 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,797 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,797 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,797 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,797 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,797 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:25,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:25,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:25,800 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:25,800 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:25,800 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:25,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:25,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:25,900 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:25,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:25,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:25,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:25,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,924 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:25,924 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:25,924 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:25,924 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:25,925 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,925 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,933 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:25,933 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:25,934 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:25,934 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,935 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,935 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 00:53:25,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:25,936 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:25,936 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:25,937 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 00:53:26,364 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c5750d1388b344dea73bb8a13bc2b4b6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5750d1388b344dea73bb8a13bc2b4b6 2023-11-18 00:53:26,777 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/ea811c31b0b341d982f6d157d213cbee 2023-11-18 00:53:26,789 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/ea811c31b0b341d982f6d157d213cbee as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/ea811c31b0b341d982f6d157d213cbee 2023-11-18 00:53:26,809 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/ea811c31b0b341d982f6d157d213cbee, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 00:53:26,810 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 873ms, sequenceid=9, compaction requested=false 2023-11-18 00:53:26,811 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:26,811 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:26,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:26,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:26,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:26,812 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:26,815 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,815 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:26,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,816 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:26,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:26,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:26,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:26,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@458b8bfe[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:26,820 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:26,820 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,827 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:26,828 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,828 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:26,834 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:26,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:26,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:26,840 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:26,840 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:26,840 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:26,840 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,840 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:26,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:26,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:26,845 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,850 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,856 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,856 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,856 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,856 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,856 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,856 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,856 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,856 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:26,857 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:26,857 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:26,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:26,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:26,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:26,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:26,858 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:26,858 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:26,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:26,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:26,941 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:53:26,959 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:26,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:26,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:26,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:26,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,987 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:26,987 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:26,987 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:26,988 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:26,988 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,988 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,992 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:26,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:26,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:26,993 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,994 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:26,994 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:26,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:26,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:26,995 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,005 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 00:53:27,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:27,010 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:27,010 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:27,010 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:27,010 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:27,010 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:27,050 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-18 00:53:27,052 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-18 00:53:27,470 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e3eee55a6baa4e91bcfa0810e88bcf3d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e3eee55a6baa4e91bcfa0810e88bcf3d 2023-11-18 00:53:27,884 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/d40e399e18f04a66a662fcbf9ff1bbc2 2023-11-18 00:53:27,893 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/d40e399e18f04a66a662fcbf9ff1bbc2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/d40e399e18f04a66a662fcbf9ff1bbc2 2023-11-18 00:53:27,902 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/d40e399e18f04a66a662fcbf9ff1bbc2, entries=1, sequenceid=13, filesize=5.0 K 2023-11-18 00:53:27,903 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 893ms, sequenceid=13, compaction requested=true 2023-11-18 00:53:27,903 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:27,903 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:27,903 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:27,907 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:27,908 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:27,908 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47290e8c[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:27,910 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:27,910 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,911 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,912 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:27,912 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:27,912 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:27,912 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,912 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:27,914 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:27,914 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:27,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:27,918 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:27,918 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:27,918 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:27,918 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,918 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:27,920 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,920 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:27,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,920 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:27,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:27,922 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,924 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:27,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:27,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:27,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:27,930 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:27,931 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:27,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:27,932 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:27,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:28,032 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:28,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:28,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:28,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:28,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,047 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:28,047 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:28,047 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:28,047 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:28,048 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,048 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,050 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:28,050 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:28,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:28,050 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,050 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:28,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,051 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,052 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 00:53:28,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,052 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:28,052 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:28,052 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:28,053 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:28,053 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:28,053 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:28,053 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:28,053 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:28,483 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120590672eaf05f545b29519ba3e288a915e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120590672eaf05f545b29519ba3e288a915e 2023-11-18 00:53:28,627 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-18 00:53:28,628 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-18 00:53:28,899 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/7f472d7682f844cebf8848fee73ce8dc 2023-11-18 00:53:28,909 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/7f472d7682f844cebf8848fee73ce8dc as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/7f472d7682f844cebf8848fee73ce8dc 2023-11-18 00:53:28,916 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/7f472d7682f844cebf8848fee73ce8dc, entries=1, sequenceid=17, filesize=5.0 K 2023-11-18 00:53:28,917 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 864ms, sequenceid=17, compaction requested=true 2023-11-18 00:53:28,917 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:28,918 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:28,918 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:28,919 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:28,919 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,919 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:28,919 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:28,922 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,922 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:28,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:28,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:28,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:28,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:28,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:28,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16e76654[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:28,926 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:28,926 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,927 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,927 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:28,927 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:28,927 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:28,927 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,928 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:28,929 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:28,929 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,929 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:28,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:28,929 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:28,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:28,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:28,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:28,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:28,933 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:28,933 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:28,934 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:28,934 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,934 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:28,940 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,940 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:28,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:28,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,940 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:28,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:28,941 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:28,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,943 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,947 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,947 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,947 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:28,947 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:28,947 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:28,948 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:28,948 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:28,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 00:53:28,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:28,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:28,948 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:28,948 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:28,948 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:28,949 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:28,949 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:29,049 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:29,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:29,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:29,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:29,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,062 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:29,062 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:29,063 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:29,063 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:29,064 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,064 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,065 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:29,065 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:29,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:29,066 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,066 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:29,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,068 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,068 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 00:53:29,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:29,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:29,069 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:29,069 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:29,069 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:29,069 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:29,069 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:29,069 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:29,494 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285556e23510f04a98b52b35829956e350 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285556e23510f04a98b52b35829956e350 2023-11-18 00:53:29,906 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/a41f79fa897d4fdb86c9926bb9c78e6e 2023-11-18 00:53:29,915 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/a41f79fa897d4fdb86c9926bb9c78e6e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/a41f79fa897d4fdb86c9926bb9c78e6e 2023-11-18 00:53:29,922 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/a41f79fa897d4fdb86c9926bb9c78e6e, entries=1, sequenceid=21, filesize=5.0 K 2023-11-18 00:53:29,923 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 854ms, sequenceid=21, compaction requested=true 2023-11-18 00:53:29,923 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:29,924 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:29,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:29,930 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,930 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:29,931 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,931 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:29,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:29,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:29,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:29,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@169847c9[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:29,933 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:29,933 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,934 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,935 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:29,935 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:29,935 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:29,935 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,935 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:29,936 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:29,936 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,936 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:29,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:29,936 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:29,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:29,940 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:29,940 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:29,940 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:29,940 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,940 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:29,943 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,943 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,943 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:29,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:29,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:29,944 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,945 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:29,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,949 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,949 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,949 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:29,949 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:29,949 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:29,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:29,950 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:29,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 00:53:29,949 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:29,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:29,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:29,950 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,950 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,950 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:29,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:29,951 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:29,951 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:30,051 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:30,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:30,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:30,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:30,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,062 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:30,062 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:30,062 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:30,062 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:30,063 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,063 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,065 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:30,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:30,065 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:30,065 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,065 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:30,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,066 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,066 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 00:53:30,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,067 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:30,067 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:30,067 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:30,067 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:30,067 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:30,067 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:30,067 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:30,068 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:30,089 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f4033509d15c466497f9b0f634f9faae to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231f4033509d15c466497f9b0f634f9faae 2023-11-18 00:53:30,098 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/acfcfb9f19794d79abc303c1eb450829 2023-11-18 00:53:30,105 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/acfcfb9f19794d79abc303c1eb450829 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/acfcfb9f19794d79abc303c1eb450829 2023-11-18 00:53:30,112 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/acfcfb9f19794d79abc303c1eb450829, entries=1, sequenceid=25, filesize=5.0 K 2023-11-18 00:53:30,114 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 47ms, sequenceid=25, compaction requested=true 2023-11-18 00:53:30,114 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:30,114 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:30,114 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:30,114 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:30,114 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,114 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:30,114 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:30,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:30,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fd5fa9f[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:30,120 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:30,120 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,121 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,122 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:30,122 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:30,122 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:30,122 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,122 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:30,125 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,125 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,125 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:30,125 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:30,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:30,129 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:30,129 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:30,129 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:30,129 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,129 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:30,131 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,131 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,131 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,134 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,136 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,139 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,139 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,139 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:30,139 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:30,140 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:30,140 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,140 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:30,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 00:53:30,140 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:30,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:30,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:30,140 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:30,140 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,141 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:30,141 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:30,241 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:30,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:30,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:30,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:30,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,252 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:30,252 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:30,253 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:30,253 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:30,254 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,254 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,255 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,255 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:30,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:30,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:30,256 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,256 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,257 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,258 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 00:53:30,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,258 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:30,258 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:30,258 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:30,258 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:30,258 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:30,258 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:30,258 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:30,258 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:30,279 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101183f275b226e485381bf1f4cc549a688 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101183f275b226e485381bf1f4cc549a688 2023-11-18 00:53:30,288 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/fb3e1cad8e3f4f308aae95979cc153b3 2023-11-18 00:53:30,299 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/fb3e1cad8e3f4f308aae95979cc153b3 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/fb3e1cad8e3f4f308aae95979cc153b3 2023-11-18 00:53:30,307 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/fb3e1cad8e3f4f308aae95979cc153b3, entries=1, sequenceid=29, filesize=5.0 K 2023-11-18 00:53:30,309 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 51ms, sequenceid=29, compaction requested=true 2023-11-18 00:53:30,309 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:30,310 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:30,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:30,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:30,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:30,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:30,316 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,317 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,318 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,318 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:30,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:30,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c887[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:30,321 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:30,321 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,322 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,323 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:30,323 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:30,323 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:30,323 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,323 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:30,324 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:30,324 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,325 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:30,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,325 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:30,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:30,329 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:30,329 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:30,329 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:30,329 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,329 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:30,332 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,332 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,332 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:30,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:30,333 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,335 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,338 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,338 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,338 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:30,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:30,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:30,339 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:30,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 00:53:30,338 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:30,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:30,338 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:30,345 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:30,345 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:30,345 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,345 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,345 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:30,345 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:30,446 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:30,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:30,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:30,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:30,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,458 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:30,458 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:30,458 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:30,458 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:30,459 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,459 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,461 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:30,461 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:30,461 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,461 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:30,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,462 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,462 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 00:53:30,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,463 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:30,463 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:30,463 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:30,463 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:30,463 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:30,463 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:30,463 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:30,463 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:30,484 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e228f14ac476486cb093f46941253a95 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e228f14ac476486cb093f46941253a95 2023-11-18 00:53:30,895 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/eb72ba663a324ff482143021482c4ebb 2023-11-18 00:53:30,904 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/eb72ba663a324ff482143021482c4ebb as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/eb72ba663a324ff482143021482c4ebb 2023-11-18 00:53:30,912 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/eb72ba663a324ff482143021482c4ebb, entries=1, sequenceid=33, filesize=5.0 K 2023-11-18 00:53:30,914 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 451ms, sequenceid=33, compaction requested=true 2023-11-18 00:53:30,914 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:30,914 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,915 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:30,915 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:30,917 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,917 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,917 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,917 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:30,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d7fcb15[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:30,919 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:30,919 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,922 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,922 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:30,922 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:30,922 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:30,922 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,922 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:30,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:30,924 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:30,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,924 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:30,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:30,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:30,928 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:30,928 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:30,928 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:30,928 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,928 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:30,931 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,931 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:30,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:30,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,931 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:30,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:30,932 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:30,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:30,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:30,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,934 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:30,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,937 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,937 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,937 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:30,938 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,938 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:30,938 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:30,938 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:30,938 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:30,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:30,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:30,938 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:30,938 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:30,939 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:30,939 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:30,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:30,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:31,039 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:31,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:31,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:31,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:31,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,082 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:31,082 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:31,083 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:31,083 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:31,083 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,083 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,085 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,085 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:31,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:31,086 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,086 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:31,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,088 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:31,088 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:31,088 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:31,088 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:31,088 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:31,088 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:31,088 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:31,089 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:31,108 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907aa07b3135b0e4ec1b4de852a9d7285b9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907aa07b3135b0e4ec1b4de852a9d7285b9 2023-11-18 00:53:31,520 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/e9b87e6f7c6e43f99f9993e9d673816b 2023-11-18 00:53:31,528 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/e9b87e6f7c6e43f99f9993e9d673816b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e9b87e6f7c6e43f99f9993e9d673816b 2023-11-18 00:53:31,534 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e9b87e6f7c6e43f99f9993e9d673816b, entries=1, sequenceid=37, filesize=5.0 K 2023-11-18 00:53:31,535 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 446ms, sequenceid=37, compaction requested=true 2023-11-18 00:53:31,536 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:31,536 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:31,536 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:31,536 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:31,536 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,536 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:31,536 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:31,538 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,538 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,539 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:31,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:31,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@798d677c[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:31,541 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:31,541 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,542 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:31,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:31,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:31,542 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,542 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:31,549 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:31,549 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,549 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:31,550 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:31,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:31,553 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:31,553 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:31,553 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:31,553 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,553 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:31,555 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,555 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:31,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,555 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:31,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:31,556 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,558 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,564 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,564 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,564 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,564 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:31,564 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,564 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:31,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:31,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:31,564 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:31,564 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:31,565 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:31,565 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,565 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:31,565 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:31,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:31,665 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:31,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:31,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:31,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:31,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,677 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:31,677 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:31,677 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 00:53:31,677 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 00:53:31,678 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,678 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,680 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:31,680 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:31,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:31,681 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:31,681 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:31,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:31,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,682 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,682 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 00:53:31,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:31,682 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 00:53:31,682 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:31,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 00:53:31,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:31,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:31,683 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:31,683 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. started... 2023-11-18 00:53:31,684 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f60a03911e1e030bc0df0fdae03cbef3 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:32,103 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201b3ccdf732414369a4b477ce665a8edb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201b3ccdf732414369a4b477ce665a8edb 2023-11-18 00:53:32,512 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/f03a8c5fc6e147e79699631d81943319 2023-11-18 00:53:32,520 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/f03a8c5fc6e147e79699631d81943319 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/f03a8c5fc6e147e79699631d81943319 2023-11-18 00:53:32,526 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/f03a8c5fc6e147e79699631d81943319, entries=1, sequenceid=41, filesize=5.0 K 2023-11-18 00:53:32,527 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f60a03911e1e030bc0df0fdae03cbef3 in 843ms, sequenceid=41, compaction requested=true 2023-11-18 00:53:32,527 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:32,527 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:32,527 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:32,528 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:32,528 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,528 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 00:53:32,528 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 00:53:32,530 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,530 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:32,530 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,530 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:32,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:32,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:32,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 00:53:32,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@592c6bd0[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:32,532 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 00:53:32,532 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,533 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,534 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 00:53:32,534 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 00:53:32,534 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:32,534 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,534 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 00:53:32,536 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:32,536 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 00:53:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:32,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 00:53:32,541 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 00:53:32,541 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:32,541 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:32,541 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,541 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:32,543 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,543 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:32,543 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:32,544 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,545 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,548 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:32,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 00:53:32,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 00:53:32,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:32,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:32,548 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:32,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:32,549 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:32,549 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:32,649 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:32,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:32,655 DEBUG [Listener at localhost/41175] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-18 00:53:32,658 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-18 00:53:32,659 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:32,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 00:53:32,675 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 00:53:32,677 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269412677 2023-11-18 00:53:32,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:53:32,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:53:32,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-18 00:53:32,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:32,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x3eef9e3b to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:53:32,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c142d6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:53:32,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:32,833 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b0c9d40887eb4d3d98ddaac52c67ac20 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b0c9d40887eb4d3d98ddaac52c67ac20 2023-11-18 00:53:32,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:32,857 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:53:32,859 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:53:32,886 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:53:32,888 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:53:32,935 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6aee1afe9a5a4ea69efa6c5180eaa29c first=Optional[r3] last=Optional[r6] 2023-11-18 00:53:32,950 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6aee1afe9a5a4ea69efa6c5180eaa29c}] 2023-11-18 00:53:32,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6aee1afe9a5a4ea69efa6c5180eaa29c for inclusion in f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:32,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 00:53:32,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:53:32,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:32,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6aee1afe9a5a4ea69efa6c5180eaa29c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mvnnh17eabg2p2df39gv0tufd8b8slbmt6hbu79en7e1mfctenagsc57iv0v9fuq/family1/6aee1afe9a5a4ea69efa6c5180eaa29c 2023-11-18 00:53:32,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mvnnh17eabg2p2df39gv0tufd8b8slbmt6hbu79en7e1mfctenagsc57iv0v9fuq/family1/6aee1afe9a5a4ea69efa6c5180eaa29c as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/aa92a753e8524756a2919df594efc3ce_SeqId_44_ 2023-11-18 00:53:32,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mvnnh17eabg2p2df39gv0tufd8b8slbmt6hbu79en7e1mfctenagsc57iv0v9fuq/family1/6aee1afe9a5a4ea69efa6c5180eaa29c into f60a03911e1e030bc0df0fdae03cbef3/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/aa92a753e8524756a2919df594efc3ce_SeqId_44_ - updating store file list. 2023-11-18 00:53:32,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/aa92a753e8524756a2919df594efc3ce_SeqId_44_ into f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:32,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mvnnh17eabg2p2df39gv0tufd8b8slbmt6hbu79en7e1mfctenagsc57iv0v9fuq/family1/6aee1afe9a5a4ea69efa6c5180eaa29c into f60a03911e1e030bc0df0fdae03cbef3/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/aa92a753e8524756a2919df594efc3ce_SeqId_44_) 2023-11-18 00:53:32,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mvnnh17eabg2p2df39gv0tufd8b8slbmt6hbu79en7e1mfctenagsc57iv0v9fuq/family1/6aee1afe9a5a4ea69efa6c5180eaa29c 2023-11-18 00:53:33,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 00:53:33,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 00:53:33,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): f60a03911e1e030bc0df0fdae03cbef3/family1 is initiating minor compaction 2023-11-18 00:53:33,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@55357041; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:33,017 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f60a03911e1e030bc0df0fdae03cbef3/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:33,018 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/ea811c31b0b341d982f6d157d213cbee, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/d40e399e18f04a66a662fcbf9ff1bbc2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/7f472d7682f844cebf8848fee73ce8dc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/a41f79fa897d4fdb86c9926bb9c78e6e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/acfcfb9f19794d79abc303c1eb450829, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/fb3e1cad8e3f4f308aae95979cc153b3, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/eb72ba663a324ff482143021482c4ebb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e9b87e6f7c6e43f99f9993e9d673816b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/f03a8c5fc6e147e79699631d81943319, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/aa92a753e8524756a2919df594efc3ce_SeqId_44_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp, totalSize=50.2 K 2023-11-18 00:53:33,018 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting ea811c31b0b341d982f6d157d213cbee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 00:53:33,018 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting d40e399e18f04a66a662fcbf9ff1bbc2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 00:53:33,018 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 7f472d7682f844cebf8848fee73ce8dc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 00:53:33,019 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting a41f79fa897d4fdb86c9926bb9c78e6e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 00:53:33,019 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting acfcfb9f19794d79abc303c1eb450829, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 00:53:33,019 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting fb3e1cad8e3f4f308aae95979cc153b3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 00:53:33,019 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting eb72ba663a324ff482143021482c4ebb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 00:53:33,019 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting e9b87e6f7c6e43f99f9993e9d673816b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 00:53:33,019 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting f03a8c5fc6e147e79699631d81943319, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 00:53:33,019 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting aa92a753e8524756a2919df594efc3ce_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 00:53:33,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:33,035 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:33,042 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285556e23510f04a98b52b35829956e350 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285556e23510f04a98b52b35829956e350 2023-11-18 00:53:33,044 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231f4033509d15c466497f9b0f634f9faae to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231f4033509d15c466497f9b0f634f9faae 2023-11-18 00:53:33,046 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101183f275b226e485381bf1f4cc549a688 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101183f275b226e485381bf1f4cc549a688 2023-11-18 00:53:33,048 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e228f14ac476486cb093f46941253a95 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e228f14ac476486cb093f46941253a95 2023-11-18 00:53:33,048 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-18 00:53:33,048 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 00:53:33,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,087 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): f60a03911e1e030bc0df0fdae03cbef3#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:53:33,187 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059e3ded5472ca4dc091283a46d6351f12 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512059e3ded5472ca4dc091283a46d6351f12 2023-11-18 00:53:33,188 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:33,229 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fcf47114be8646eaa855562d1146d5a5 first=Optional[r00] last=Optional[r2] 2023-11-18 00:53:33,230 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fcf47114be8646eaa855562d1146d5a5}] 2023-11-18 00:53:33,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fcf47114be8646eaa855562d1146d5a5 for inclusion in f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:33,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-18 00:53:33,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:53:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:33,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fcf47114be8646eaa855562d1146d5a5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mkaurct5sd5vah87ec4ip1gp8607ds370sj2cm1t5de95e9k2omvg128lvdgp1f1/family1/fcf47114be8646eaa855562d1146d5a5 2023-11-18 00:53:33,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mkaurct5sd5vah87ec4ip1gp8607ds370sj2cm1t5de95e9k2omvg128lvdgp1f1/family1/fcf47114be8646eaa855562d1146d5a5 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_ 2023-11-18 00:53:33,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mkaurct5sd5vah87ec4ip1gp8607ds370sj2cm1t5de95e9k2omvg128lvdgp1f1/family1/fcf47114be8646eaa855562d1146d5a5 into f60a03911e1e030bc0df0fdae03cbef3/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_ - updating store file list. 2023-11-18 00:53:33,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_ into f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:33,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mkaurct5sd5vah87ec4ip1gp8607ds370sj2cm1t5de95e9k2omvg128lvdgp1f1/family1/fcf47114be8646eaa855562d1146d5a5 into f60a03911e1e030bc0df0fdae03cbef3/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_) 2023-11-18 00:53:33,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mkaurct5sd5vah87ec4ip1gp8607ds370sj2cm1t5de95e9k2omvg128lvdgp1f1/family1/fcf47114be8646eaa855562d1146d5a5 2023-11-18 00:53:33,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:33,251 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:33,253 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e6625ab1dd5f4e878daf1d2380f14ab2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e6625ab1dd5f4e878daf1d2380f14ab2 2023-11-18 00:53:33,254 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e3eee55a6baa4e91bcfa0810e88bcf3d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e3eee55a6baa4e91bcfa0810e88bcf3d 2023-11-18 00:53:33,256 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120590672eaf05f545b29519ba3e288a915e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120590672eaf05f545b29519ba3e288a915e 2023-11-18 00:53:33,256 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-18 00:53:33,256 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 00:53:33,257 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:33,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:33,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:53:33,258 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 00:53:33,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 594 msec 2023-11-18 00:53:33,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 00:53:33,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:33,539 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/6b3c8971a69747dd8a8ad3a343e86cd0 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/6b3c8971a69747dd8a8ad3a343e86cd0 2023-11-18 00:53:33,552 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f60a03911e1e030bc0df0fdae03cbef3/family1 of f60a03911e1e030bc0df0fdae03cbef3 into 6b3c8971a69747dd8a8ad3a343e86cd0(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:53:33,552 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:33,553 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1700268813011; duration=0sec 2023-11-18 00:53:33,554 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:33,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/ea811c31b0b341d982f6d157d213cbee, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/d40e399e18f04a66a662fcbf9ff1bbc2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/7f472d7682f844cebf8848fee73ce8dc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/a41f79fa897d4fdb86c9926bb9c78e6e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/acfcfb9f19794d79abc303c1eb450829, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/fb3e1cad8e3f4f308aae95979cc153b3, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/eb72ba663a324ff482143021482c4ebb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e9b87e6f7c6e43f99f9993e9d673816b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/f03a8c5fc6e147e79699631d81943319, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/aa92a753e8524756a2919df594efc3ce_SeqId_44_] to archive 2023-11-18 00:53:33,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:33,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/ea811c31b0b341d982f6d157d213cbee to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/ea811c31b0b341d982f6d157d213cbee 2023-11-18 00:53:33,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/d40e399e18f04a66a662fcbf9ff1bbc2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/d40e399e18f04a66a662fcbf9ff1bbc2 2023-11-18 00:53:33,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/7f472d7682f844cebf8848fee73ce8dc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/7f472d7682f844cebf8848fee73ce8dc 2023-11-18 00:53:33,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/a41f79fa897d4fdb86c9926bb9c78e6e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/a41f79fa897d4fdb86c9926bb9c78e6e 2023-11-18 00:53:33,646 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/acfcfb9f19794d79abc303c1eb450829 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/acfcfb9f19794d79abc303c1eb450829 2023-11-18 00:53:33,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/fb3e1cad8e3f4f308aae95979cc153b3 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/fb3e1cad8e3f4f308aae95979cc153b3 2023-11-18 00:53:33,649 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/eb72ba663a324ff482143021482c4ebb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/eb72ba663a324ff482143021482c4ebb 2023-11-18 00:53:33,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e9b87e6f7c6e43f99f9993e9d673816b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e9b87e6f7c6e43f99f9993e9d673816b 2023-11-18 00:53:33,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/f03a8c5fc6e147e79699631d81943319 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/f03a8c5fc6e147e79699631d81943319 2023-11-18 00:53:33,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/aa92a753e8524756a2919df594efc3ce_SeqId_44_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/aa92a753e8524756a2919df594efc3ce_SeqId_44_ 2023-11-18 00:53:33,831 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-18 00:53:33,833 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-18 00:53:33,833 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-18 00:53:33,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-18 00:53:33,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f60a03911e1e030bc0df0fdae03cbef3, REOPEN/MOVE}] 2023-11-18 00:53:33,852 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f60a03911e1e030bc0df0fdae03cbef3, REOPEN/MOVE 2023-11-18 00:53:33,854 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f60a03911e1e030bc0df0fdae03cbef3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:33,854 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700268813853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268813853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268813853"}]},"ts":"1700268813853"} 2023-11-18 00:53:33,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure f60a03911e1e030bc0df0fdae03cbef3, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:53:34,013 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:34,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f60a03911e1e030bc0df0fdae03cbef3, disabling compactions & flushes 2023-11-18 00:53:34,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:34,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:34,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. after waiting 0 ms 2023-11-18 00:53:34,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:34,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-18 00:53:34,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:34,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:34,025 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: f60a03911e1e030bc0df0fdae03cbef3 to self. 2023-11-18 00:53:34,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,028 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f60a03911e1e030bc0df0fdae03cbef3, regionState=CLOSED 2023-11-18 00:53:34,028 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700268814028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268814028"}]},"ts":"1700268814028"} 2023-11-18 00:53:34,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-18 00:53:34,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure f60a03911e1e030bc0df0fdae03cbef3, server=jenkins-hbase4.apache.org,46287,1700268799711 in 174 msec 2023-11-18 00:53:34,033 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f60a03911e1e030bc0df0fdae03cbef3, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=true 2023-11-18 00:53:34,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f60a03911e1e030bc0df0fdae03cbef3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:34,184 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700268814183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268814183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268814183"}]},"ts":"1700268814183"} 2023-11-18 00:53:34,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure f60a03911e1e030bc0df0fdae03cbef3, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:53:34,339 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:34,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:34,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f60a03911e1e030bc0df0fdae03cbef3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:53:34,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:34,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,346 INFO [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,347 DEBUG [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:34,347 DEBUG [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:34,347 INFO [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f60a03911e1e030bc0df0fdae03cbef3 columnFamilyName family1 2023-11-18 00:53:34,360 DEBUG [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/6b3c8971a69747dd8a8ad3a343e86cd0 2023-11-18 00:53:34,368 DEBUG [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/971229f668f44063b36e593f4b5a0ed5 2023-11-18 00:53:34,373 DEBUG [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_ 2023-11-18 00:53:34,374 INFO [StoreOpener-f60a03911e1e030bc0df0fdae03cbef3-1] regionserver.HStore(310): Store=f60a03911e1e030bc0df0fdae03cbef3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:34,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:53:34,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f60a03911e1e030bc0df0fdae03cbef3; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63062506, jitterRate=-0.060295432806015015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:53:34,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:34,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3., pid=17, masterSystemTime=1700268814338 2023-11-18 00:53:34,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-18 00:53:34,387 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 00:53:34,390 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 00:53:34,390 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1912): f60a03911e1e030bc0df0fdae03cbef3/family1 is initiating minor compaction (all files) 2023-11-18 00:53:34,390 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f60a03911e1e030bc0df0fdae03cbef3/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:34,390 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/971229f668f44063b36e593f4b5a0ed5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/6b3c8971a69747dd8a8ad3a343e86cd0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp, totalSize=358.6 K 2023-11-18 00:53:34,391 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 971229f668f44063b36e593f4b5a0ed5, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823326 2023-11-18 00:53:34,392 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 6b3c8971a69747dd8a8ad3a343e86cd0, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223326 2023-11-18 00:53:34,393 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878823326 2023-11-18 00:53:34,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:34,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:53:34,397 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f60a03911e1e030bc0df0fdae03cbef3, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:34,397 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700268814397"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268814397"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268814397"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268814397"}]},"ts":"1700268814397"} 2023-11-18 00:53:34,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-18 00:53:34,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure f60a03911e1e030bc0df0fdae03cbef3, server=jenkins-hbase4.apache.org,46287,1700268799711 in 224 msec 2023-11-18 00:53:34,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-18 00:53:34,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=f60a03911e1e030bc0df0fdae03cbef3, REOPEN/MOVE in 563 msec 2023-11-18 00:53:34,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-18 00:53:34,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 581 msec 2023-11-18 00:53:34,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0150 sec 2023-11-18 00:53:34,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-18 00:53:34,445 INFO [Listener at localhost/41175] compactions.TestMobCompactor(278): alter status finished 2023-11-18 00:53:34,446 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): f60a03911e1e030bc0df0fdae03cbef3#family1#compaction#11 average throughput is 4.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:53:34,446 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 00:53:34,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 00:53:34,458 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 00:53:34,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:53:34,459 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269414459 2023-11-18 00:53:34,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:53:34,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-18 00:53:34,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:34,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x6862b413 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:53:34,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6eb2f43a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:53:34,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:34,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:34,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:34,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:34,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:35,344 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b058f9547cde4cc7a94af38c4886e8f2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128b058f9547cde4cc7a94af38c4886e8f2 2023-11-18 00:53:35,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:35,359 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:53:35,360 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:53:35,368 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:53:35,370 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:53:35,380 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/957411a7c5624948aae7797ae6b2cee8 first=Optional[r05] last=Optional[r8] 2023-11-18 00:53:35,381 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=50 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/957411a7c5624948aae7797ae6b2cee8}] 2023-11-18 00:53:35,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/957411a7c5624948aae7797ae6b2cee8 for inclusion in f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:35,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-18 00:53:35,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:53:35,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:35,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/957411a7c5624948aae7797ae6b2cee8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jcu2oq4hsl0gsbpci06rnvjfav00ccqas478c6k7vsgbqbuhhbb9isk52pecehbs/family1/957411a7c5624948aae7797ae6b2cee8 2023-11-18 00:53:35,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jcu2oq4hsl0gsbpci06rnvjfav00ccqas478c6k7vsgbqbuhhbb9isk52pecehbs/family1/957411a7c5624948aae7797ae6b2cee8 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/bcb3d3b19a254eb08f8ad4021c9aba08_SeqId_52_ 2023-11-18 00:53:35,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jcu2oq4hsl0gsbpci06rnvjfav00ccqas478c6k7vsgbqbuhhbb9isk52pecehbs/family1/957411a7c5624948aae7797ae6b2cee8 into f60a03911e1e030bc0df0fdae03cbef3/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/bcb3d3b19a254eb08f8ad4021c9aba08_SeqId_52_ - updating store file list. 2023-11-18 00:53:35,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/bcb3d3b19a254eb08f8ad4021c9aba08_SeqId_52_ into f60a03911e1e030bc0df0fdae03cbef3/family1 2023-11-18 00:53:35,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jcu2oq4hsl0gsbpci06rnvjfav00ccqas478c6k7vsgbqbuhhbb9isk52pecehbs/family1/957411a7c5624948aae7797ae6b2cee8 into f60a03911e1e030bc0df0fdae03cbef3/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/bcb3d3b19a254eb08f8ad4021c9aba08_SeqId_52_) 2023-11-18 00:53:35,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jcu2oq4hsl0gsbpci06rnvjfav00ccqas478c6k7vsgbqbuhhbb9isk52pecehbs/family1/957411a7c5624948aae7797ae6b2cee8 2023-11-18 00:53:35,402 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:35,403 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:35,405 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201b3ccdf732414369a4b477ce665a8edb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201b3ccdf732414369a4b477ce665a8edb 2023-11-18 00:53:35,406 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5750d1388b344dea73bb8a13bc2b4b6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5750d1388b344dea73bb8a13bc2b4b6 2023-11-18 00:53:35,406 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-18 00:53:35,406 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 00:53:35,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:35,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:35,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 00:53:35,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 00:53:35,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:53:35,408 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 00:53:35,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 959 msec 2023-11-18 00:53:35,509 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=255 (was 214) Potentially hanging thread: RS:0;jenkins-hbase4:46287-shortCompactions-0 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:940) org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:880) org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:863) org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:818) org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72) org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.finishClose(HFileWriterImpl.java:820) org.apache.hadoop.hbase.io.hfile.HFileWriterImpl.close(HFileWriterImpl.java:654) org.apache.hadoop.hbase.regionserver.StoreFileWriter.close(StoreFileWriter.java:359) org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.commitWriter(DefaultCompactor.java:89) org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.commitWriter(DefaultCompactor.java:42) org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:362) org.apache.hadoop.hbase.mob.DefaultMobStoreCompactor.compact(DefaultMobStoreCompactor.java:108) org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:122) org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1473) org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:2267) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:625) org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:673) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74687642-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7f674984-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40810 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x3eef9e3b sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1685700726.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40914 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40970 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40864 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/ab207311a68e435c93917a2287110528 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40934 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40748 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x6862b413-SendThread(127.0.0.1:58527) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x74687642-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74687642-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:41004 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40924 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/cluster_8c545dd1-5e13-fa17-ac7b-07a423d1c876/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7f674984-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x6862b413-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/cluster_8c545dd1-5e13-fa17-ac7b-07a423d1c876/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1714494648_17 at /127.0.0.1:40838 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40916 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40956 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x6862b413 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1685700726.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40848 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7f674984-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40774 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74687642-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74687642-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x3eef9e3b-SendThread(127.0.0.1:58527) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40990 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40888 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x3eef9e3b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) - Thread LEAK? -, OpenFileDescriptor=627 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=368 (was 277) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9595 (was 9906) 2023-11-18 00:53:35,524 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=255, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=171, AvailableMemoryMB=9593 2023-11-18 00:53:35,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 00:53:35,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:35,528 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:53:35,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-18 00:53:35,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:53:35,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 00:53:35,531 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:35,532 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268 empty. 2023-11-18 00:53:35,532 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:35,532 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-18 00:53:35,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 00:53:35,715 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/.tmp/family1/ab207311a68e435c93917a2287110528 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/ab207311a68e435c93917a2287110528 2023-11-18 00:53:35,722 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f60a03911e1e030bc0df0fdae03cbef3/family1 of f60a03911e1e030bc0df0fdae03cbef3 into ab207311a68e435c93917a2287110528(size=177.2 K), total size for store is 182.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:53:35,722 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:53:35,722 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3., storeName=f60a03911e1e030bc0df0fdae03cbef3/family1, priority=13, startTime=1700268814386; duration=1sec 2023-11-18 00:53:35,722 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:35,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/971229f668f44063b36e593f4b5a0ed5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/6b3c8971a69747dd8a8ad3a343e86cd0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_] to archive 2023-11-18 00:53:35,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:35,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/971229f668f44063b36e593f4b5a0ed5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/971229f668f44063b36e593f4b5a0ed5 2023-11-18 00:53:35,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/6b3c8971a69747dd8a8ad3a343e86cd0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/6b3c8971a69747dd8a8ad3a343e86cd0 2023-11-18 00:53:35,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/family1/e0dcdeccaea34a60baf502bfa8826da9_SeqId_46_ 2023-11-18 00:53:35,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 00:53:35,942 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-18 00:53:35,944 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 55540310ce3ac98ac0e635e984990268, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:53:35,950 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:35,950 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 55540310ce3ac98ac0e635e984990268, disabling compactions & flushes 2023-11-18 00:53:35,950 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:35,950 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:35,950 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. after waiting 0 ms 2023-11-18 00:53:35,950 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:35,950 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:35,950 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:35,954 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:53:35,955 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700268815955"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268815955"}]},"ts":"1700268815955"} 2023-11-18 00:53:35,957 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:53:35,958 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:53:35,958 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268815958"}]},"ts":"1700268815958"} 2023-11-18 00:53:35,960 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-18 00:53:35,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=55540310ce3ac98ac0e635e984990268, ASSIGN}] 2023-11-18 00:53:35,965 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=55540310ce3ac98ac0e635e984990268, ASSIGN 2023-11-18 00:53:35,966 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=55540310ce3ac98ac0e635e984990268, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:53:36,117 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=55540310ce3ac98ac0e635e984990268, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:36,117 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700268816117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268816117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268816117"}]},"ts":"1700268816117"} 2023-11-18 00:53:36,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 55540310ce3ac98ac0e635e984990268, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:53:36,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 00:53:36,271 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:36,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:36,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 55540310ce3ac98ac0e635e984990268, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:53:36,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:36,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:36,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:36,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:36,277 INFO [StoreOpener-55540310ce3ac98ac0e635e984990268-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:36,347 DEBUG [StoreOpener-55540310ce3ac98ac0e635e984990268-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1 2023-11-18 00:53:36,347 DEBUG [StoreOpener-55540310ce3ac98ac0e635e984990268-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1 2023-11-18 00:53:36,347 INFO [StoreOpener-55540310ce3ac98ac0e635e984990268-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55540310ce3ac98ac0e635e984990268 columnFamilyName family1 2023-11-18 00:53:36,349 INFO [StoreOpener-55540310ce3ac98ac0e635e984990268-1] regionserver.HStore(310): Store=55540310ce3ac98ac0e635e984990268/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:36,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:36,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:36,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 55540310ce3ac98ac0e635e984990268 2023-11-18 00:53:36,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:53:36,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 55540310ce3ac98ac0e635e984990268; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74122474, jitterRate=0.10451093316078186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:53:36,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:36,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268., pid=21, masterSystemTime=1700268816271 2023-11-18 00:53:36,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:36,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:36,360 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=55540310ce3ac98ac0e635e984990268, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:36,360 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700268816360"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268816360"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268816360"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268816360"}]},"ts":"1700268816360"} 2023-11-18 00:53:36,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-18 00:53:36,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 55540310ce3ac98ac0e635e984990268, server=jenkins-hbase4.apache.org,46287,1700268799711 in 243 msec 2023-11-18 00:53:36,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-18 00:53:36,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=55540310ce3ac98ac0e635e984990268, ASSIGN in 401 msec 2023-11-18 00:53:36,367 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:53:36,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268816367"}]},"ts":"1700268816367"} 2023-11-18 00:53:36,369 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-18 00:53:36,414 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:53:36,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 888 msec 2023-11-18 00:53:36,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 00:53:36,635 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-18 00:53:36,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:36,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:36,674 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:36,674 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:36,675 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:36,675 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:36,676 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:36,676 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:36,720 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:36,720 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:36,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:36,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:36,720 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:36,720 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:36,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:36,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:36,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:36,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:36,722 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:36,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:36,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:36,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:36,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:36,723 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:36,723 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:36,723 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:36,723 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:36,723 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 00:53:37,158 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130356af04e80c34648a4997b157ed9b0ee to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130356af04e80c34648a4997b157ed9b0ee 2023-11-18 00:53:37,161 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/70065fc7271a45dba5f70f80b8dc2d30 2023-11-18 00:53:37,167 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/70065fc7271a45dba5f70f80b8dc2d30 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/70065fc7271a45dba5f70f80b8dc2d30 2023-11-18 00:53:37,173 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/70065fc7271a45dba5f70f80b8dc2d30, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-18 00:53:37,174 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 451ms, sequenceid=5, compaction requested=false 2023-11-18 00:53:37,174 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:37,175 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:37,175 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:37,175 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:37,175 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:37,175 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,175 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:37,175 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:37,258 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,258 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,259 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:37,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:37,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67d1c382[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:37,261 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:37,261 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,335 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,335 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:37,336 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:37,336 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:37,336 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,336 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:37,389 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,389 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:37,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:37,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:37,389 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:37,389 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:37,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:37,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:37,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:37,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:37,394 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:37,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:37,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:37,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,394 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:37,435 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,435 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:37,435 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:37,436 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,438 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,620 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,620 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:37,620 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:37,620 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:37,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:37,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:37,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:37,620 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,620 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:37,621 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,621 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,621 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,621 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,621 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:37,622 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:37,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:37,722 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:37,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:37,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:37,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:37,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,731 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:37,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:37,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:37,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:37,732 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,732 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,774 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:37,774 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:37,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:37,774 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:37,774 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:37,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,775 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:37,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:37,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:37,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:37,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:37,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:37,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:37,776 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:37,776 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:37,776 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 00:53:38,192 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a63e5125c0074b1487c79dba6c2c676e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128a63e5125c0074b1487c79dba6c2c676e 2023-11-18 00:53:38,598 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/7eb4f90aba624e2596a7242f075c5fdf 2023-11-18 00:53:38,605 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/7eb4f90aba624e2596a7242f075c5fdf as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/7eb4f90aba624e2596a7242f075c5fdf 2023-11-18 00:53:38,611 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/7eb4f90aba624e2596a7242f075c5fdf, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 00:53:38,612 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 836ms, sequenceid=9, compaction requested=false 2023-11-18 00:53:38,612 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:38,612 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:38,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:38,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:38,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:38,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:38,616 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,616 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:38,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:38,616 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:38,617 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:38,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:38,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:38,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:38,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34258b0e[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:38,618 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:38,619 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,620 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,620 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:38,620 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:38,620 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,620 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:38,620 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:38,621 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,622 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:38,622 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:38,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:38,625 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:38,625 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:38,625 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:38,625 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,625 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:38,627 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,627 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,627 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:38,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:38,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:38,628 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,629 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,633 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,633 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,633 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:38,633 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,633 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:38,633 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:38,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:38,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:38,633 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:38,634 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,634 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,634 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,634 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:38,634 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:38,734 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:38,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:38,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:38,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:38,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,743 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:38,743 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:38,744 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:38,744 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:38,744 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,744 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,746 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,746 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:38,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:38,746 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:38,746 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,747 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,747 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:38,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:38,748 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:38,748 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:38,748 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:39,163 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201992b912b9e6e4b39ae68289fcad42e92 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201992b912b9e6e4b39ae68289fcad42e92 2023-11-18 00:53:39,551 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:53:39,569 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/55b793f87d3d4e7bbc751058f8c1ae1b 2023-11-18 00:53:39,576 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/55b793f87d3d4e7bbc751058f8c1ae1b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/55b793f87d3d4e7bbc751058f8c1ae1b 2023-11-18 00:53:39,582 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/55b793f87d3d4e7bbc751058f8c1ae1b, entries=1, sequenceid=13, filesize=4.9 K 2023-11-18 00:53:39,584 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 836ms, sequenceid=13, compaction requested=true 2023-11-18 00:53:39,584 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:39,584 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:39,584 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:39,584 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:39,584 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,584 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:39,584 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:39,586 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:39,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:39,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:39,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:39,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:39,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:39,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:39,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2681ac71[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:39,589 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:39,589 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,590 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,590 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:39,590 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:39,590 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,591 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:39,591 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:39,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:39,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:39,593 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:39,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:39,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:39,596 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:39,597 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:39,597 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:39,597 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,597 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:39,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:39,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:39,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:39,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:39,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:39,599 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:39,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,601 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:39,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,603 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,603 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,603 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:39,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:39,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:39,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:39,604 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:39,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:39,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:39,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:39,605 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:39,605 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:39,705 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:39,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:39,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:39,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:39,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,714 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:39,714 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:39,715 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:39,715 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:39,716 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,716 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,719 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:39,719 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:39,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:39,719 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:39,719 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:39,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,721 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,721 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:39,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:39,721 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:39,721 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:39,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:39,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:39,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:39,722 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:39,722 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:39,722 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:40,139 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054877dde66fe24dcd826aac2ece9e4a4c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512054877dde66fe24dcd826aac2ece9e4a4c 2023-11-18 00:53:40,545 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/a04b56921a8b43e99d211a4bf4196271 2023-11-18 00:53:40,554 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/a04b56921a8b43e99d211a4bf4196271 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/a04b56921a8b43e99d211a4bf4196271 2023-11-18 00:53:40,562 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/a04b56921a8b43e99d211a4bf4196271, entries=1, sequenceid=17, filesize=4.9 K 2023-11-18 00:53:40,563 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 841ms, sequenceid=17, compaction requested=true 2023-11-18 00:53:40,563 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:40,563 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:40,563 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:40,563 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:40,563 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,563 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:40,563 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:40,566 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,566 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,567 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:40,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:40,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:40,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:40,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:40,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c49219a[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:40,568 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:40,568 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,569 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,570 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:40,570 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:40,570 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:40,573 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,573 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:40,577 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:40,577 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:40,577 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,577 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:40,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:40,580 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:40,581 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:40,581 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:40,581 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,581 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:40,583 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,583 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:40,583 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:40,584 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,590 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,593 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:40,593 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:40,593 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:40,594 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:40,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:53:40,593 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,594 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,595 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,595 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,595 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,595 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:40,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:40,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:40,595 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:40,595 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:40,695 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:40,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:40,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:40,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:40,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,704 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:40,704 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:40,704 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:40,704 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:40,705 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,705 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,706 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:40,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:40,707 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:40,707 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,708 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,709 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:40,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:40,709 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:40,709 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:40,709 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:40,710 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:40,710 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:40,710 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:41,126 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a3187a0b1d104e8d9e62dde7279b4ed2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3187a0b1d104e8d9e62dde7279b4ed2 2023-11-18 00:53:41,131 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/1d77c49b82114138bdcea92b9668efcf 2023-11-18 00:53:41,137 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/1d77c49b82114138bdcea92b9668efcf as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/1d77c49b82114138bdcea92b9668efcf 2023-11-18 00:53:41,142 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/1d77c49b82114138bdcea92b9668efcf, entries=1, sequenceid=21, filesize=4.9 K 2023-11-18 00:53:41,143 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 433ms, sequenceid=21, compaction requested=true 2023-11-18 00:53:41,143 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:41,144 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:41,144 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:41,144 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:41,144 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,144 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:41,144 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:41,147 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:41,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:41,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@756d3c42[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:41,149 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:41,149 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,151 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:41,151 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:41,151 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:41,151 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,151 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:41,153 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:41,153 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,153 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:41,153 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:41,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:41,156 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:41,156 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:41,156 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:41,156 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,156 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:41,158 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,158 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:41,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:41,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,159 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:41,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:41,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:41,159 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,161 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,165 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,165 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:41,165 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:41,166 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:41,166 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:41,166 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:41,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:41,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:41,166 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,167 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,167 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,167 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,167 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:41,167 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:41,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:41,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:41,267 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:41,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:41,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:41,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:41,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,275 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:41,275 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:41,276 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:41,276 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:41,276 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,276 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,278 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,278 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:41,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:41,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:41,278 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,278 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,279 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,280 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:41,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,280 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:41,280 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:41,280 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:41,280 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:41,281 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:41,281 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:41,281 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:41,281 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:41,295 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231021e4c3d95824d8695e92e392142a189 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231021e4c3d95824d8695e92e392142a189 2023-11-18 00:53:41,702 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/04dfc4a1b1ad4e31aa37fe761d5c5f48 2023-11-18 00:53:41,708 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/04dfc4a1b1ad4e31aa37fe761d5c5f48 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/04dfc4a1b1ad4e31aa37fe761d5c5f48 2023-11-18 00:53:41,713 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/04dfc4a1b1ad4e31aa37fe761d5c5f48, entries=1, sequenceid=25, filesize=4.9 K 2023-11-18 00:53:41,714 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 433ms, sequenceid=25, compaction requested=true 2023-11-18 00:53:41,714 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:41,714 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:41,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:41,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:41,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:41,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:41,716 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,716 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:41,716 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,716 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:41,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:41,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d88a41a[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:41,718 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:41,718 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,719 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,720 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:41,720 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:41,720 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:41,720 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,720 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:41,725 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:41,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:41,725 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:41,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:41,728 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:41,728 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:41,728 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:41,728 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,728 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:41,730 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,730 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:41,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,730 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:41,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:41,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:41,730 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:41,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,732 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:41,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,734 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,734 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,734 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:41,734 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:41,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:41,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:53:41,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:41,734 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:41,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:41,734 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:41,734 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,735 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,735 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,735 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,735 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:41,735 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:41,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:41,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:41,836 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:41,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:41,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:41,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:41,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,843 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:41,844 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:41,844 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:41,844 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:41,845 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,845 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,846 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:41,846 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:41,846 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:41,846 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:41,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,847 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,847 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:41,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:41,848 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:41,848 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:41,848 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:41,848 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:42,263 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c765d592023a48f89d1abbcfc0cf0aee to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c765d592023a48f89d1abbcfc0cf0aee 2023-11-18 00:53:42,670 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/83074f86ca1f41ad921432ae208d49cb 2023-11-18 00:53:42,676 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/83074f86ca1f41ad921432ae208d49cb as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/83074f86ca1f41ad921432ae208d49cb 2023-11-18 00:53:42,682 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/83074f86ca1f41ad921432ae208d49cb, entries=1, sequenceid=29, filesize=4.9 K 2023-11-18 00:53:42,683 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 835ms, sequenceid=29, compaction requested=true 2023-11-18 00:53:42,683 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:42,683 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:42,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:42,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:42,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:42,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:42,689 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,689 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:42,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:42,690 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,690 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:42,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:42,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46c16ffe[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:42,691 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:42,691 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,692 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:42,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:42,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:42,693 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,693 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:42,694 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:42,694 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,694 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:42,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:42,694 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:42,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:42,698 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:42,698 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:42,698 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:42,698 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,698 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:42,700 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,700 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:42,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,700 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:42,700 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,702 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,705 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,705 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,705 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,705 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:42,705 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:42,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:42,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:42,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:53:42,705 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:42,705 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:42,705 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:42,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:42,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,706 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:42,706 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:42,807 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:42,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:42,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:42,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:42,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,815 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:42,815 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:42,815 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:42,815 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:42,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,817 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,817 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:42,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:42,818 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:42,818 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,819 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:42,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:42,819 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:42,819 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:42,820 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:42,820 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:42,820 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:43,236 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010384b827a15e9b4f75a4ac1ffec6819d1c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010384b827a15e9b4f75a4ac1ffec6819d1c 2023-11-18 00:53:43,242 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/c446e696fb564f7faa66469b0c906b06 2023-11-18 00:53:43,248 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/c446e696fb564f7faa66469b0c906b06 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/c446e696fb564f7faa66469b0c906b06 2023-11-18 00:53:43,253 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/c446e696fb564f7faa66469b0c906b06, entries=1, sequenceid=33, filesize=4.9 K 2023-11-18 00:53:43,254 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 434ms, sequenceid=33, compaction requested=true 2023-11-18 00:53:43,254 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:43,254 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:43,254 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:43,254 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:43,254 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,254 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:43,254 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:43,355 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,355 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:43,356 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,356 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:43,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:43,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13d1c34d[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:43,357 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:43,357 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,378 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,378 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:43,379 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:43,379 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:43,379 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,379 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:43,440 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:43,440 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,440 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:43,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:43,440 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:43,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:43,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:43,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:43,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:43,444 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:43,444 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:43,444 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:43,444 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,444 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:43,540 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,540 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,540 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:43,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:43,541 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,542 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,617 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,617 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:43,617 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:43,617 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:43,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:43,617 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:43,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:43,617 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,618 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,618 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,618 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,618 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,618 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:43,618 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:43,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:43,718 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:43,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:43,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:43,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:43,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,729 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:43,729 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:43,729 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:43,730 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:43,730 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,730 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,763 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:43,763 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:43,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:43,763 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:43,763 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:43,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,764 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:43,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:43,764 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:43,764 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:43,765 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:43,765 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:43,765 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:43,765 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:43,765 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:43,765 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:43,779 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090727d45d995c744a878539cbfcece63dc1 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090727d45d995c744a878539cbfcece63dc1 2023-11-18 00:53:44,185 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/8460c748b046495c865efc2313714a58 2023-11-18 00:53:44,191 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/8460c748b046495c865efc2313714a58 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8460c748b046495c865efc2313714a58 2023-11-18 00:53:44,197 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8460c748b046495c865efc2313714a58, entries=1, sequenceid=37, filesize=4.9 K 2023-11-18 00:53:44,198 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 433ms, sequenceid=37, compaction requested=true 2023-11-18 00:53:44,198 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:44,198 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:44,198 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:44,198 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:44,198 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,198 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:44,198 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:44,200 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,200 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:44,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:44,201 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,201 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:44,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:44,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fc27259[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:44,203 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:44,203 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,204 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,205 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:44,205 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:44,205 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:44,205 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,205 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:44,208 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,208 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:44,208 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:44,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,208 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:44,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:44,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:44,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:44,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:44,212 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:44,212 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:44,212 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:44,212 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,212 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:44,214 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,214 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,214 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:44,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:44,214 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,216 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:44,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:44,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:44,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:44,227 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:44,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:44,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:44,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:53:44,228 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:44,228 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:44,328 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:44,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:44,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:44,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:44,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,336 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:44,336 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:44,337 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:53:44,337 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:44,337 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,338 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,339 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:44,339 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:44,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:44,339 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:44,340 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:44,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:44,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,340 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,341 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:53:44,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:44,341 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:53:44,341 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:53:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:44,342 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:44,342 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:44,343 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. started... 2023-11-18 00:53:44,343 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 55540310ce3ac98ac0e635e984990268 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:44,758 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208e713fefd1e94feead43ad80685c907e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208e713fefd1e94feead43ad80685c907e 2023-11-18 00:53:45,164 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/0d0627b0374f46d79cf51060dc964baf 2023-11-18 00:53:45,170 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/0d0627b0374f46d79cf51060dc964baf as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/0d0627b0374f46d79cf51060dc964baf 2023-11-18 00:53:45,175 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/0d0627b0374f46d79cf51060dc964baf, entries=1, sequenceid=41, filesize=4.9 K 2023-11-18 00:53:45,176 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 55540310ce3ac98ac0e635e984990268 in 833ms, sequenceid=41, compaction requested=true 2023-11-18 00:53:45,176 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:45,176 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:45,176 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:45,176 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:45,176 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,176 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:53:45,176 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:53:45,178 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,178 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2742afcf[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:45,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:45,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,183 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,183 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:45,183 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:53:45,183 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:45,183 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,183 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:45,184 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,184 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:53:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:45,184 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:45,185 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:53:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:45,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:45,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:45,187 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:53:45,187 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:45,187 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:45,187 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,187 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:45,189 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,189 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,189 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:45,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:45,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:45,190 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,191 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:45,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:45,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:45,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:53:45,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 00:53:45,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:45,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:45,194 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:45,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,195 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,196 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:45,196 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:45,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:45,296 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:45,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:45,298 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-18 00:53:45,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:53:45,301 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:53:45,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:53:45,302 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269425302 2023-11-18 00:53:45,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:53:45,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-18 00:53:45,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:53:45,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x25d9d3ea to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:53:45,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cb3f04f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:53:45,320 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:53:46,156 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fb5521cf87a5448cae5c901d416fb848 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb5521cf87a5448cae5c901d416fb848 2023-11-18 00:53:46,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:53:46,173 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:53:46,175 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:53:46,188 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:53:46,189 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:53:46,218 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3fe90290d7a8450d88441346f7b2e018 first=Optional[r5] last=Optional[r6] 2023-11-18 00:53:46,219 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3fe90290d7a8450d88441346f7b2e018}] 2023-11-18 00:53:46,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3fe90290d7a8450d88441346f7b2e018 for inclusion in 55540310ce3ac98ac0e635e984990268/family1 2023-11-18 00:53:46,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-18 00:53:46,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:53:46,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:46,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3fe90290d7a8450d88441346f7b2e018 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nq17bpscs34rr1c33g2n9tfq7139jfdjvgm9ltrgpbordhukp1l7emli1nnmubas/family1/3fe90290d7a8450d88441346f7b2e018 2023-11-18 00:53:46,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nq17bpscs34rr1c33g2n9tfq7139jfdjvgm9ltrgpbordhukp1l7emli1nnmubas/family1/3fe90290d7a8450d88441346f7b2e018 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_ 2023-11-18 00:53:46,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nq17bpscs34rr1c33g2n9tfq7139jfdjvgm9ltrgpbordhukp1l7emli1nnmubas/family1/3fe90290d7a8450d88441346f7b2e018 into 55540310ce3ac98ac0e635e984990268/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_ - updating store file list. 2023-11-18 00:53:46,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_ into 55540310ce3ac98ac0e635e984990268/family1 2023-11-18 00:53:46,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nq17bpscs34rr1c33g2n9tfq7139jfdjvgm9ltrgpbordhukp1l7emli1nnmubas/family1/3fe90290d7a8450d88441346f7b2e018 into 55540310ce3ac98ac0e635e984990268/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_) 2023-11-18 00:53:46,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nq17bpscs34rr1c33g2n9tfq7139jfdjvgm9ltrgpbordhukp1l7emli1nnmubas/family1/3fe90290d7a8450d88441346f7b2e018 2023-11-18 00:53:46,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 00:53:46,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 00:53:46,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 55540310ce3ac98ac0e635e984990268/family1 is initiating minor compaction 2023-11-18 00:53:46,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4367a071; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:46,242 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 55540310ce3ac98ac0e635e984990268/family1 in testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:46,242 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/7eb4f90aba624e2596a7242f075c5fdf, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/55b793f87d3d4e7bbc751058f8c1ae1b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/a04b56921a8b43e99d211a4bf4196271, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/1d77c49b82114138bdcea92b9668efcf, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/04dfc4a1b1ad4e31aa37fe761d5c5f48, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/83074f86ca1f41ad921432ae208d49cb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/c446e696fb564f7faa66469b0c906b06, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8460c748b046495c865efc2313714a58, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/0d0627b0374f46d79cf51060dc964baf, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp, totalSize=49.7 K 2023-11-18 00:53:46,242 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 7eb4f90aba624e2596a7242f075c5fdf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 00:53:46,242 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 55b793f87d3d4e7bbc751058f8c1ae1b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 00:53:46,242 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting a04b56921a8b43e99d211a4bf4196271, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 00:53:46,242 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 1d77c49b82114138bdcea92b9668efcf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 00:53:46,242 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 04dfc4a1b1ad4e31aa37fe761d5c5f48, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 00:53:46,243 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 83074f86ca1f41ad921432ae208d49cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 00:53:46,243 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting c446e696fb564f7faa66469b0c906b06, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 00:53:46,243 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 8460c748b046495c865efc2313714a58, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 00:53:46,243 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 0d0627b0374f46d79cf51060dc964baf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 00:53:46,243 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 00:53:46,244 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:53:46,245 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:46,247 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c765d592023a48f89d1abbcfc0cf0aee to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c765d592023a48f89d1abbcfc0cf0aee 2023-11-18 00:53:46,249 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010384b827a15e9b4f75a4ac1ffec6819d1c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010384b827a15e9b4f75a4ac1ffec6819d1c 2023-11-18 00:53:46,249 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-18 00:53:46,249 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-18 00:53:46,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:53:46,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:53:46,281 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 55540310ce3ac98ac0e635e984990268#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:53:46,709 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/d71967435b3c48b58c0e563e80c33cf1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/d71967435b3c48b58c0e563e80c33cf1 2023-11-18 00:53:46,710 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311328a7c3027d441db330e682eab56c94 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512311328a7c3027d441db330e682eab56c94 2023-11-18 00:53:46,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:53:46,715 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 55540310ce3ac98ac0e635e984990268/family1 of 55540310ce3ac98ac0e635e984990268 into d71967435b3c48b58c0e563e80c33cf1(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:53:46,716 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:46,716 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700268826242; duration=0sec 2023-11-18 00:53:46,716 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:46,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/7eb4f90aba624e2596a7242f075c5fdf, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/55b793f87d3d4e7bbc751058f8c1ae1b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/a04b56921a8b43e99d211a4bf4196271, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/1d77c49b82114138bdcea92b9668efcf, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/04dfc4a1b1ad4e31aa37fe761d5c5f48, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/83074f86ca1f41ad921432ae208d49cb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/c446e696fb564f7faa66469b0c906b06, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8460c748b046495c865efc2313714a58, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/0d0627b0374f46d79cf51060dc964baf, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_] to archive 2023-11-18 00:53:46,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:46,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/7eb4f90aba624e2596a7242f075c5fdf to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/7eb4f90aba624e2596a7242f075c5fdf 2023-11-18 00:53:46,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/55b793f87d3d4e7bbc751058f8c1ae1b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/55b793f87d3d4e7bbc751058f8c1ae1b 2023-11-18 00:53:46,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/a04b56921a8b43e99d211a4bf4196271 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/a04b56921a8b43e99d211a4bf4196271 2023-11-18 00:53:46,751 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e3c068cb85e34f269b5f92a3244a60c2 first=Optional[r1] last=Optional[r4] 2023-11-18 00:53:46,752 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e3c068cb85e34f269b5f92a3244a60c2}] 2023-11-18 00:53:46,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/1d77c49b82114138bdcea92b9668efcf to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/1d77c49b82114138bdcea92b9668efcf 2023-11-18 00:53:46,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e3c068cb85e34f269b5f92a3244a60c2 for inclusion in 55540310ce3ac98ac0e635e984990268/family1 2023-11-18 00:53:46,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/04dfc4a1b1ad4e31aa37fe761d5c5f48 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/04dfc4a1b1ad4e31aa37fe761d5c5f48 2023-11-18 00:53:46,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/83074f86ca1f41ad921432ae208d49cb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/83074f86ca1f41ad921432ae208d49cb 2023-11-18 00:53:46,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/c446e696fb564f7faa66469b0c906b06 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/c446e696fb564f7faa66469b0c906b06 2023-11-18 00:53:46,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-18 00:53:46,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:53:46,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:46,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e3c068cb85e34f269b5f92a3244a60c2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uid4phifnfb9avsd974dhtljm9hhfa42isug5eh37a7nhlf3gu5mj04407lmp4mh/family1/e3c068cb85e34f269b5f92a3244a60c2 2023-11-18 00:53:46,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8460c748b046495c865efc2313714a58 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8460c748b046495c865efc2313714a58 2023-11-18 00:53:46,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/0d0627b0374f46d79cf51060dc964baf to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/0d0627b0374f46d79cf51060dc964baf 2023-11-18 00:53:46,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uid4phifnfb9avsd974dhtljm9hhfa42isug5eh37a7nhlf3gu5mj04407lmp4mh/family1/e3c068cb85e34f269b5f92a3244a60c2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/3839c1ca9b84420a8263e71933942645_SeqId_47_ 2023-11-18 00:53:46,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uid4phifnfb9avsd974dhtljm9hhfa42isug5eh37a7nhlf3gu5mj04407lmp4mh/family1/e3c068cb85e34f269b5f92a3244a60c2 into 55540310ce3ac98ac0e635e984990268/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/3839c1ca9b84420a8263e71933942645_SeqId_47_ - updating store file list. 2023-11-18 00:53:46,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/fa0c24a535ae4347ae0906ae7e09c3f0_SeqId_44_ 2023-11-18 00:53:46,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/3839c1ca9b84420a8263e71933942645_SeqId_47_ into 55540310ce3ac98ac0e635e984990268/family1 2023-11-18 00:53:46,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uid4phifnfb9avsd974dhtljm9hhfa42isug5eh37a7nhlf3gu5mj04407lmp4mh/family1/e3c068cb85e34f269b5f92a3244a60c2 into 55540310ce3ac98ac0e635e984990268/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/3839c1ca9b84420a8263e71933942645_SeqId_47_) 2023-11-18 00:53:46,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uid4phifnfb9avsd974dhtljm9hhfa42isug5eh37a7nhlf3gu5mj04407lmp4mh/family1/e3c068cb85e34f269b5f92a3244a60c2 2023-11-18 00:53:46,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 00:53:46,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 00:53:46,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 55540310ce3ac98ac0e635e984990268/family1 is initiating minor compaction (all files) 2023-11-18 00:53:46,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@55b3743d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:46,773 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 55540310ce3ac98ac0e635e984990268/family1 in testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:53:46,774 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/70065fc7271a45dba5f70f80b8dc2d30, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/d71967435b3c48b58c0e563e80c33cf1, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/3839c1ca9b84420a8263e71933942645_SeqId_47_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp, totalSize=178.1 K 2023-11-18 00:53:46,774 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 70065fc7271a45dba5f70f80b8dc2d30, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823326 2023-11-18 00:53:46,775 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting d71967435b3c48b58c0e563e80c33cf1, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223326 2023-11-18 00:53:46,776 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 3839c1ca9b84420a8263e71933942645_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223326 2023-11-18 00:53:46,776 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:53:46,777 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:46,781 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201992b912b9e6e4b39ae68289fcad42e92 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201992b912b9e6e4b39ae68289fcad42e92 2023-11-18 00:53:46,783 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512054877dde66fe24dcd826aac2ece9e4a4c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512054877dde66fe24dcd826aac2ece9e4a4c 2023-11-18 00:53:46,785 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3187a0b1d104e8d9e62dde7279b4ed2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3187a0b1d104e8d9e62dde7279b4ed2 2023-11-18 00:53:46,786 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231021e4c3d95824d8695e92e392142a189 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231021e4c3d95824d8695e92e392142a189 2023-11-18 00:53:46,786 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-18 00:53:46,786 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-18 00:53:46,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:53:46,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:53:46,800 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 55540310ce3ac98ac0e635e984990268#family1#compaction#23 average throughput is 12.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:53:47,653 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d729736916504cff916cf497be4fd6bd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130d729736916504cff916cf497be4fd6bd 2023-11-18 00:53:47,654 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:53:47,686 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5bcb7f380b4f45aca746773725f422d8 first=Optional[r00] last=Optional[r8] 2023-11-18 00:53:47,687 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5bcb7f380b4f45aca746773725f422d8}] 2023-11-18 00:53:47,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5bcb7f380b4f45aca746773725f422d8 for inclusion in 55540310ce3ac98ac0e635e984990268/family1 2023-11-18 00:53:47,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-18 00:53:47,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:53:47,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:47,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5bcb7f380b4f45aca746773725f422d8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lgqsqhahge5372rlad0hqslvfjbj3j8ogur4jevnvsdlfih1dh6eijqqh8r2lqie/family1/5bcb7f380b4f45aca746773725f422d8 2023-11-18 00:53:47,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lgqsqhahge5372rlad0hqslvfjbj3j8ogur4jevnvsdlfih1dh6eijqqh8r2lqie/family1/5bcb7f380b4f45aca746773725f422d8 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8b350771bfe14ea489fa720f71974df9_SeqId_49_ 2023-11-18 00:53:47,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lgqsqhahge5372rlad0hqslvfjbj3j8ogur4jevnvsdlfih1dh6eijqqh8r2lqie/family1/5bcb7f380b4f45aca746773725f422d8 into 55540310ce3ac98ac0e635e984990268/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8b350771bfe14ea489fa720f71974df9_SeqId_49_ - updating store file list. 2023-11-18 00:53:47,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8b350771bfe14ea489fa720f71974df9_SeqId_49_ into 55540310ce3ac98ac0e635e984990268/family1 2023-11-18 00:53:47,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lgqsqhahge5372rlad0hqslvfjbj3j8ogur4jevnvsdlfih1dh6eijqqh8r2lqie/family1/5bcb7f380b4f45aca746773725f422d8 into 55540310ce3ac98ac0e635e984990268/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/8b350771bfe14ea489fa720f71974df9_SeqId_49_) 2023-11-18 00:53:47,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lgqsqhahge5372rlad0hqslvfjbj3j8ogur4jevnvsdlfih1dh6eijqqh8r2lqie/family1/5bcb7f380b4f45aca746773725f422d8 2023-11-18 00:53:47,708 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:53:47,709 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:47,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208e713fefd1e94feead43ad80685c907e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511208e713fefd1e94feead43ad80685c907e 2023-11-18 00:53:47,712 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128a63e5125c0074b1487c79dba6c2c676e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128a63e5125c0074b1487c79dba6c2c676e 2023-11-18 00:53:47,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130356af04e80c34648a4997b157ed9b0ee to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130356af04e80c34648a4997b157ed9b0ee 2023-11-18 00:53:47,714 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-18 00:53:47,714 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 00:53:47,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:53:47,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:53:47,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:53:47,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:53:47,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:53:47,716 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:53:47,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4170 sec 2023-11-18 00:53:47,827 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=259 (was 255) Potentially hanging thread: hconnection-0x19dda934-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:37964 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x25d9d3ea-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:40810 [Waiting for operation #34] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x25d9d3ea-SendThread(127.0.0.1:58527) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:37956 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19dda934-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:37954 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19dda934-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19dda934-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1714494648_17 at /127.0.0.1:37932 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58527@0x25d9d3ea sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1685700726.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:38080 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:37942 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/d5bff5a2c19d414893c476d578a95973 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1714494648_17 at /127.0.0.1:46440 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:46418 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:37898 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19dda934-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:38076 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:37882 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19dda934-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:37874 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:38002 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:37924 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2146571823_17 at /127.0.0.1:38030 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19dda934-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=638 (was 627) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=300 (was 368), ProcessCount=171 (was 171), AvailableMemoryMB=9492 (was 9593) 2023-11-18 00:53:47,838 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=300, ProcessCount=171, AvailableMemoryMB=9492 2023-11-18 00:53:47,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 00:53:47,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:47,843 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:53:47,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-18 00:53:47,844 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:53:47,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 00:53:47,846 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:47,847 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0 empty. 2023-11-18 00:53:47,847 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:47,847 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-18 00:53:47,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 00:53:48,027 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/.tmp/family1/d5bff5a2c19d414893c476d578a95973 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/d5bff5a2c19d414893c476d578a95973 2023-11-18 00:53:48,033 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 55540310ce3ac98ac0e635e984990268/family1 of 55540310ce3ac98ac0e635e984990268 into d5bff5a2c19d414893c476d578a95973(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:53:48,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:53:48,034 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700268826773; duration=1sec 2023-11-18 00:53:48,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:48,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/70065fc7271a45dba5f70f80b8dc2d30, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/d71967435b3c48b58c0e563e80c33cf1, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/3839c1ca9b84420a8263e71933942645_SeqId_47_] to archive 2023-11-18 00:53:48,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:48,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/70065fc7271a45dba5f70f80b8dc2d30 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/70065fc7271a45dba5f70f80b8dc2d30 2023-11-18 00:53:48,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/d71967435b3c48b58c0e563e80c33cf1 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/d71967435b3c48b58c0e563e80c33cf1 2023-11-18 00:53:48,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/3839c1ca9b84420a8263e71933942645_SeqId_47_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/family1/3839c1ca9b84420a8263e71933942645_SeqId_47_ 2023-11-18 00:53:48,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 00:53:48,256 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-18 00:53:48,258 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4c699eeeeaea417afe3f12a85af3bbd0, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:53:48,268 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:48,269 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 4c699eeeeaea417afe3f12a85af3bbd0, disabling compactions & flushes 2023-11-18 00:53:48,269 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:48,269 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:48,269 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. after waiting 0 ms 2023-11-18 00:53:48,269 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:48,269 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:48,269 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:48,272 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:53:48,273 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700268828273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268828273"}]},"ts":"1700268828273"} 2023-11-18 00:53:48,275 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:53:48,276 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:53:48,276 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268828276"}]},"ts":"1700268828276"} 2023-11-18 00:53:48,278 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-18 00:53:48,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=4c699eeeeaea417afe3f12a85af3bbd0, ASSIGN}] 2023-11-18 00:53:48,285 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=4c699eeeeaea417afe3f12a85af3bbd0, ASSIGN 2023-11-18 00:53:48,286 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=4c699eeeeaea417afe3f12a85af3bbd0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:53:48,437 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=4c699eeeeaea417afe3f12a85af3bbd0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:48,437 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700268828437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268828437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268828437"}]},"ts":"1700268828437"} 2023-11-18 00:53:48,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 4c699eeeeaea417afe3f12a85af3bbd0, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:53:48,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 00:53:48,591 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:48,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:48,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c699eeeeaea417afe3f12a85af3bbd0, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:53:48,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:48,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:53:48,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:48,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:48,598 INFO [StoreOpener-4c699eeeeaea417afe3f12a85af3bbd0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:48,599 DEBUG [StoreOpener-4c699eeeeaea417afe3f12a85af3bbd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1 2023-11-18 00:53:48,600 DEBUG [StoreOpener-4c699eeeeaea417afe3f12a85af3bbd0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1 2023-11-18 00:53:48,600 INFO [StoreOpener-4c699eeeeaea417afe3f12a85af3bbd0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c699eeeeaea417afe3f12a85af3bbd0 columnFamilyName family1 2023-11-18 00:53:48,602 INFO [StoreOpener-4c699eeeeaea417afe3f12a85af3bbd0-1] regionserver.HStore(310): Store=4c699eeeeaea417afe3f12a85af3bbd0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:53:48,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:48,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:48,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:53:48,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:53:48,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c699eeeeaea417afe3f12a85af3bbd0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68582494, jitterRate=0.02195879817008972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:53:48,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:48,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0., pid=25, masterSystemTime=1700268828591 2023-11-18 00:53:48,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:48,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:48,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=4c699eeeeaea417afe3f12a85af3bbd0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:48,613 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700268828613"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268828613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268828613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268828613"}]},"ts":"1700268828613"} 2023-11-18 00:53:48,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-18 00:53:48,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 4c699eeeeaea417afe3f12a85af3bbd0, server=jenkins-hbase4.apache.org,46287,1700268799711 in 176 msec 2023-11-18 00:53:48,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-18 00:53:48,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=4c699eeeeaea417afe3f12a85af3bbd0, ASSIGN in 335 msec 2023-11-18 00:53:48,621 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:53:48,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268828621"}]},"ts":"1700268828621"} 2023-11-18 00:53:48,622 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-18 00:53:48,625 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:53:48,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 784 msec 2023-11-18 00:53:48,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 00:53:48,949 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-18 00:53:48,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:48,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:48,977 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:48,977 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:48,977 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:48,977 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:48,977 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:48,977 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:48,978 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:48,978 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:48,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:48,979 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:48,979 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:48,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:48,980 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:48,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:48,980 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:48,980 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:48,980 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:48,980 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:48,980 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:48,980 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:48,980 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:48,981 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 00:53:49,403 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c70825cc144f43c6b9e208b5253e2373 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130c70825cc144f43c6b9e208b5253e2373 2023-11-18 00:53:49,807 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/057b1fb61e274c2c94f65f0cbc400037 2023-11-18 00:53:49,813 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/057b1fb61e274c2c94f65f0cbc400037 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/057b1fb61e274c2c94f65f0cbc400037 2023-11-18 00:53:49,818 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/057b1fb61e274c2c94f65f0cbc400037, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-18 00:53:49,819 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 838ms, sequenceid=5, compaction requested=false 2023-11-18 00:53:49,819 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:49,819 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:49,819 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:49,820 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:49,820 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:49,820 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,820 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:49,820 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:49,827 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,827 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:49,828 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,828 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:49,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:49,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a318a46[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:49,829 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:49,829 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,831 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,832 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:49,832 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:49,832 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:49,832 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,832 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:49,833 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,833 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:49,833 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:49,833 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:49,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:49,836 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:49,836 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:49,836 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:49,836 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,836 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:49,838 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,838 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,838 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:49,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:49,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:49,838 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:49,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:49,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,840 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:49,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:49,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:49,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:49,843 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:49,843 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:49,844 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:49,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:49,944 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:49,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:49,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:49,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:49,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,951 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:49,951 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:49,951 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:49,951 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:49,952 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,952 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,953 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,953 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:49,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:49,954 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:49,954 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,955 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,955 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:49,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:49,955 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:49,955 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:49,955 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:49,955 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:49,955 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:49,955 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:49,956 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:49,956 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 00:53:50,371 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128eb368f33a74c4dbeb4f7b66f1c862aee to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128eb368f33a74c4dbeb4f7b66f1c862aee 2023-11-18 00:53:50,778 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/c289f526e6e349439f4fafb3ae993880 2023-11-18 00:53:50,784 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/c289f526e6e349439f4fafb3ae993880 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c289f526e6e349439f4fafb3ae993880 2023-11-18 00:53:50,789 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c289f526e6e349439f4fafb3ae993880, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 00:53:50,790 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 834ms, sequenceid=9, compaction requested=false 2023-11-18 00:53:50,790 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:50,790 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:50,790 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:50,790 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:50,790 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,790 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:50,790 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:50,797 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,797 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:50,797 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,797 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:50,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:50,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77e7f7e6[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:50,799 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:50,799 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,800 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,800 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:50,800 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:50,800 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:50,801 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,801 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:50,802 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,802 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:50,802 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:50,802 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:50,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:50,804 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:50,804 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:50,804 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:50,805 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,805 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:50,807 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,807 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:50,807 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:50,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:50,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:50,807 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:50,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,809 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:50,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,817 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,817 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:50,817 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:50,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:50,817 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:50,817 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:50,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:50,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:50,817 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,818 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,818 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:50,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:50,818 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,818 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:50,818 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,818 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:50,918 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:50,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:50,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:50,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:50,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,926 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:50,926 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:50,926 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:50,926 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:50,926 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,926 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,928 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:50,928 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:50,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:50,928 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:50,928 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:50,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:50,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,929 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,929 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:50,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:50,929 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:50,929 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:50,929 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:50,930 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:50,930 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:50,930 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:50,930 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:50,930 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:51,344 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120112fd2e7eaa3240d3a0a84b0a9918b08b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120112fd2e7eaa3240d3a0a84b0a9918b08b 2023-11-18 00:53:51,751 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/9f3dd773725d44128dbf6ca405c64181 2023-11-18 00:53:51,756 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/9f3dd773725d44128dbf6ca405c64181 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/9f3dd773725d44128dbf6ca405c64181 2023-11-18 00:53:51,761 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/9f3dd773725d44128dbf6ca405c64181, entries=1, sequenceid=13, filesize=4.9 K 2023-11-18 00:53:51,762 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 832ms, sequenceid=13, compaction requested=true 2023-11-18 00:53:51,762 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:51,762 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:51,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:51,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:51,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:51,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:51,764 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,764 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:51,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:51,765 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,765 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:51,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:51,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:51,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:51,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:51,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bab03f9[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:51,766 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:51,766 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,767 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:51,768 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,768 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:51,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,770 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:51,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:51,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:51,772 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:51,772 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:51,773 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:51,773 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,773 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:51,774 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,774 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:51,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:51,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,774 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:51,775 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:51,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,776 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:51,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,779 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:51,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:51,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:51,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:51,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:51,779 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:51,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:51,780 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:51,880 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:51,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:51,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:51,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:51,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,887 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:51,887 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:51,887 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:51,887 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:51,887 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,887 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,889 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,889 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:51,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:51,889 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:51,889 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:51,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:51,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,890 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,890 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:51,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:51,890 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:51,891 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:51,891 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:51,891 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:52,304 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ba8fdf3fac4947f5bc4f113d364a1cb4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ba8fdf3fac4947f5bc4f113d364a1cb4 2023-11-18 00:53:52,710 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/f4a82609206c4d5ca9bb2a75d63255e1 2023-11-18 00:53:52,716 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/f4a82609206c4d5ca9bb2a75d63255e1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/f4a82609206c4d5ca9bb2a75d63255e1 2023-11-18 00:53:52,721 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/f4a82609206c4d5ca9bb2a75d63255e1, entries=1, sequenceid=17, filesize=4.9 K 2023-11-18 00:53:52,722 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 831ms, sequenceid=17, compaction requested=true 2023-11-18 00:53:52,722 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:52,722 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:52,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:52,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:52,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,723 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:52,723 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:52,726 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,726 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:52,726 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,726 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:52,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:52,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59a5f594[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:52,728 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:52,728 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,729 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,729 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:52,729 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:52,729 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:52,729 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,729 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:52,731 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,731 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:52,731 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:52,731 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:52,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:52,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:52,734 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:52,734 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:52,734 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:52,734 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,734 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:52,735 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,735 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:52,735 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:52,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:52,736 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:52,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,738 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:52,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,743 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,743 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,743 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,743 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,743 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:52,743 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:52,743 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:52,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:52,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:52,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:52,743 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:52,744 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,744 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,744 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:52,744 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:52,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:52,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:52,844 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:52,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:52,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:52,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:52,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,851 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:52,851 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:52,851 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:52,851 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:52,851 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,851 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,853 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,853 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:52,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:52,853 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:52,853 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,854 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,854 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:52,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:52,854 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:52,854 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:52,855 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:52,855 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:52,855 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:52,855 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:52,855 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:52,855 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:53,269 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288ea89d38c7e3489cb9f0273b8e20e135 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512288ea89d38c7e3489cb9f0273b8e20e135 2023-11-18 00:53:53,675 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/86f9ea6ee7f745abb6c174dd93c5560e 2023-11-18 00:53:53,681 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/86f9ea6ee7f745abb6c174dd93c5560e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/86f9ea6ee7f745abb6c174dd93c5560e 2023-11-18 00:53:53,685 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/86f9ea6ee7f745abb6c174dd93c5560e, entries=1, sequenceid=21, filesize=4.9 K 2023-11-18 00:53:53,686 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 831ms, sequenceid=21, compaction requested=true 2023-11-18 00:53:53,686 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:53,686 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:53,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:53,689 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,689 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:53,689 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:53,689 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:53,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:53,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fa0375c[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:53,691 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:53,691 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,692 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,692 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:53,693 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,693 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:53,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:53,696 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,696 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:53,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:53,697 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:53,697 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:53,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:53,699 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:53,699 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:53,699 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:53,699 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,699 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:53,701 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,701 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:53,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,701 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:53,702 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,703 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,706 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:53,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,706 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:53,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:53,707 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:53,807 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:53,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:53,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:53,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:53,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,814 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:53,814 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:53,814 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:53,814 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:53,814 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,814 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,816 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:53,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:53,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:53,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,817 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,817 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:53,817 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:53,817 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:53,817 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:53,817 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:53,817 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:53,818 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:53,818 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:53,818 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:54,123 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:53:54,231 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315c0b1ceb1c9e495a885a59face72cceb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512315c0b1ceb1c9e495a885a59face72cceb 2023-11-18 00:53:54,637 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/4d1817d422a045eca678ab8e604e8a77 2023-11-18 00:53:54,643 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/4d1817d422a045eca678ab8e604e8a77 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/4d1817d422a045eca678ab8e604e8a77 2023-11-18 00:53:54,647 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/4d1817d422a045eca678ab8e604e8a77, entries=1, sequenceid=25, filesize=4.9 K 2023-11-18 00:53:54,648 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 830ms, sequenceid=25, compaction requested=true 2023-11-18 00:53:54,648 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:54,648 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:54,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,650 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:54,650 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,650 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:54,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:54,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7730bf89[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:54,652 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:54,652 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,653 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,653 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:54,653 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:54,653 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,653 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:54,653 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:54,655 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:54,655 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,655 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:54,655 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:54,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:54,657 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:54,658 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:54,658 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:54,658 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,658 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:54,660 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,660 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,660 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:54,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:54,661 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,662 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,665 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,665 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,665 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:54,665 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:54,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 00:53:54,665 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:54,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:54,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:54,665 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:54,665 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,666 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:54,666 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:54,666 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:54,666 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:54,666 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,766 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:54,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:54,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:54,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:54,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,773 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:54,773 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:54,773 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:54,773 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:54,773 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,773 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,775 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,775 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:54,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:54,775 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:54,775 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:54,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,776 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,776 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:54,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:54,776 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:54,776 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:54,777 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:55,190 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011ab9adbf57f94cafa138c128bd27ced5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011ab9adbf57f94cafa138c128bd27ced5 2023-11-18 00:53:55,596 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/889fd29b712141d6a61db6b7bd14d998 2023-11-18 00:53:55,602 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/889fd29b712141d6a61db6b7bd14d998 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/889fd29b712141d6a61db6b7bd14d998 2023-11-18 00:53:55,607 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/889fd29b712141d6a61db6b7bd14d998, entries=1, sequenceid=29, filesize=4.9 K 2023-11-18 00:53:55,608 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 831ms, sequenceid=29, compaction requested=true 2023-11-18 00:53:55,608 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:55,608 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:55,608 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:55,608 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:55,608 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,608 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:55,608 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:55,610 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,610 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:55,610 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,610 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:55,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:55,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4437ce5d[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:55,612 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:55,612 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,615 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,615 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:55,615 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:55,615 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:55,615 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,615 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:55,616 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,617 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:55,617 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:55,617 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:55,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:55,619 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:55,619 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:55,619 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:55,619 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,619 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:55,625 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,625 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,625 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:55,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:55,625 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,626 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:55,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:55,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:55,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:55,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:55,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 00:53:55,629 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:55,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:55,630 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:55,629 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,630 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,730 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:55,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:55,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:55,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:55,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,736 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:55,736 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:55,736 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:55,736 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:55,737 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,737 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,738 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:55,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:55,738 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:55,738 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,739 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,740 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:55,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:55,740 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:55,740 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:55,740 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:55,740 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:55,740 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:55,740 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:55,740 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:55,740 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:56,154 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034003a5ad7e3f414eab702c42f46d4d69 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034003a5ad7e3f414eab702c42f46d4d69 2023-11-18 00:53:56,559 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/c44889e79c5c4bb7a604574bdee358cd 2023-11-18 00:53:56,565 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/c44889e79c5c4bb7a604574bdee358cd as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c44889e79c5c4bb7a604574bdee358cd 2023-11-18 00:53:56,570 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c44889e79c5c4bb7a604574bdee358cd, entries=1, sequenceid=33, filesize=4.9 K 2023-11-18 00:53:56,571 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 831ms, sequenceid=33, compaction requested=true 2023-11-18 00:53:56,571 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:56,571 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:56,571 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:56,571 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:56,571 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,571 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:56,571 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:56,574 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,574 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:56,574 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,574 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:56,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:56,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:56,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:56,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32c88a1a[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:56,576 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:56,576 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,577 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,577 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:56,577 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:56,577 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:56,577 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,577 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:56,579 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,579 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:56,579 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:56,579 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:56,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:56,581 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:56,581 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:56,581 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:56,581 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,581 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:56,583 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,583 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:56,583 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:56,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:56,584 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,585 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:56,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,589 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,589 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,589 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:56,589 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,589 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:56,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 00:53:56,589 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:56,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:56,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:56,589 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:56,589 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,590 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,590 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:56,590 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:56,590 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:56,690 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:56,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:56,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:56,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:56,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,697 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:56,697 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:56,697 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:56,697 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:56,698 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,698 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,699 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:56,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:56,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:56,699 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:56,700 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:56,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:56,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,700 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,701 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:56,701 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:56,701 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:56,701 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:56,701 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:56,701 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:56,701 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:56,701 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:56,701 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:56,701 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:57,115 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078bc0d635fe0b49f1af2d0281f27f0ca5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509078bc0d635fe0b49f1af2d0281f27f0ca5 2023-11-18 00:53:57,520 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/a11db41ce25f4dd48d4e2c7456ec4be7 2023-11-18 00:53:57,526 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/a11db41ce25f4dd48d4e2c7456ec4be7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/a11db41ce25f4dd48d4e2c7456ec4be7 2023-11-18 00:53:57,531 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/a11db41ce25f4dd48d4e2c7456ec4be7, entries=1, sequenceid=37, filesize=4.9 K 2023-11-18 00:53:57,532 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 831ms, sequenceid=37, compaction requested=true 2023-11-18 00:53:57,532 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:57,532 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:57,532 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:57,532 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:57,532 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,532 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:57,532 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:57,534 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,534 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:57,535 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,535 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:57,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:57,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c6c41c8[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:57,536 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:57,536 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,538 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:57,538 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:57,538 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,538 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:57,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:57,542 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:57,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:57,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:57,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:57,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:57,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:57,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:57,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:57,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:57,544 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:57,544 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:57,544 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:57,544 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,544 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:57,546 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,546 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,546 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:57,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:57,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:57,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:57,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:57,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:57,547 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:57,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,548 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:57,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,550 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:57,551 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:57,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:57,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:57,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:57,551 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:57,651 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:57,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:57,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:53:57,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:53:57,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,658 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:57,658 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:57,658 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:53:57,658 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:53:57,659 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,659 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,661 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,661 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:57,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:57,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:57,661 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:57,661 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:53:57,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:53:57,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,662 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:53:57,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:53:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:53:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:53:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:53:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:53:57,663 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:57,663 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. started... 2023-11-18 00:53:57,663 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4c699eeeeaea417afe3f12a85af3bbd0 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:53:57,679 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120923088fa656449018abb7c7e489bec5e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120923088fa656449018abb7c7e489bec5e 2023-11-18 00:53:58,085 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/3305b5a4c5934a1ba8d1a8572d738349 2023-11-18 00:53:58,091 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/3305b5a4c5934a1ba8d1a8572d738349 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/3305b5a4c5934a1ba8d1a8572d738349 2023-11-18 00:53:58,096 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/3305b5a4c5934a1ba8d1a8572d738349, entries=1, sequenceid=41, filesize=4.9 K 2023-11-18 00:53:58,097 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4c699eeeeaea417afe3f12a85af3bbd0 in 434ms, sequenceid=41, compaction requested=true 2023-11-18 00:53:58,097 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:58,097 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:58,097 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:53:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:53:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:53:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:53:58,100 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,100 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:58,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:53:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:58,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:53:58,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e526b3b[Count = 0] remaining members to acquire global barrier 2023-11-18 00:53:58,102 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:53:58,103 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,106 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,106 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:53:58,106 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:53:58,107 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:53:58,107 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,107 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:53:58,108 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,108 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:53:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:58,108 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:58,108 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:53:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:53:58,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:53:58,110 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:53:58,110 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:53:58,110 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:53:58,111 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,111 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:53:58,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:53:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:53:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:53:58,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:58,113 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:53:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,114 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:53:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:53:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:53:58,118 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:53:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:53:58,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 00:53:58,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:53:58,118 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:53:58,118 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:53:58,118 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,118 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:53:58,118 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:53:58,118 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,118 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:53:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:53:58,218 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:53:58,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:53:58,221 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-18 00:53:58,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:53:58,223 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:53:58,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:53:58,224 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269438224 2023-11-18 00:53:58,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 00:53:58,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-18 00:53:58,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:53:58,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x35ad6ef1 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:53:58,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76dfc183, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:53:58,233 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,074 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010332083e9c9f054f978ef23becbc82d9c9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010332083e9c9f054f978ef23becbc82d9c9 2023-11-18 00:53:59,075 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:53:59,088 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:53:59,089 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:53:59,096 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:53:59,097 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:53:59,106 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/04d1d6ba8c054457b211947e6f5ffd41 first=Optional[r3] last=Optional[r6] 2023-11-18 00:53:59,106 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/04d1d6ba8c054457b211947e6f5ffd41}] 2023-11-18 00:53:59,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/04d1d6ba8c054457b211947e6f5ffd41 for inclusion in 4c699eeeeaea417afe3f12a85af3bbd0/family1 2023-11-18 00:53:59,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 00:53:59,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:53:59,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:59,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/04d1d6ba8c054457b211947e6f5ffd41 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r7epf7fc7do422akc6gu9rc3p83081i81bqm8bjvdiccv0sloo7q79hq6b8dvri9/family1/04d1d6ba8c054457b211947e6f5ffd41 2023-11-18 00:53:59,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r7epf7fc7do422akc6gu9rc3p83081i81bqm8bjvdiccv0sloo7q79hq6b8dvri9/family1/04d1d6ba8c054457b211947e6f5ffd41 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/34934efe902145aebe660824009fb58f_SeqId_44_ 2023-11-18 00:53:59,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r7epf7fc7do422akc6gu9rc3p83081i81bqm8bjvdiccv0sloo7q79hq6b8dvri9/family1/04d1d6ba8c054457b211947e6f5ffd41 into 4c699eeeeaea417afe3f12a85af3bbd0/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/34934efe902145aebe660824009fb58f_SeqId_44_ - updating store file list. 2023-11-18 00:53:59,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/34934efe902145aebe660824009fb58f_SeqId_44_ into 4c699eeeeaea417afe3f12a85af3bbd0/family1 2023-11-18 00:53:59,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r7epf7fc7do422akc6gu9rc3p83081i81bqm8bjvdiccv0sloo7q79hq6b8dvri9/family1/04d1d6ba8c054457b211947e6f5ffd41 into 4c699eeeeaea417afe3f12a85af3bbd0/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/34934efe902145aebe660824009fb58f_SeqId_44_) 2023-11-18 00:53:59,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r7epf7fc7do422akc6gu9rc3p83081i81bqm8bjvdiccv0sloo7q79hq6b8dvri9/family1/04d1d6ba8c054457b211947e6f5ffd41 2023-11-18 00:53:59,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 00:53:59,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 00:53:59,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 4c699eeeeaea417afe3f12a85af3bbd0/family1 is initiating minor compaction 2023-11-18 00:53:59,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@321e590b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:59,126 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4c699eeeeaea417afe3f12a85af3bbd0/family1 in testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:53:59,126 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c289f526e6e349439f4fafb3ae993880, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/9f3dd773725d44128dbf6ca405c64181, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/f4a82609206c4d5ca9bb2a75d63255e1, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/86f9ea6ee7f745abb6c174dd93c5560e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/4d1817d422a045eca678ab8e604e8a77, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/889fd29b712141d6a61db6b7bd14d998, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c44889e79c5c4bb7a604574bdee358cd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/a11db41ce25f4dd48d4e2c7456ec4be7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/3305b5a4c5934a1ba8d1a8572d738349, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/34934efe902145aebe660824009fb58f_SeqId_44_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp, totalSize=50.0 K 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting c289f526e6e349439f4fafb3ae993880, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 9f3dd773725d44128dbf6ca405c64181, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting f4a82609206c4d5ca9bb2a75d63255e1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 86f9ea6ee7f745abb6c174dd93c5560e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 4d1817d422a045eca678ab8e604e8a77, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 889fd29b712141d6a61db6b7bd14d998, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting c44889e79c5c4bb7a604574bdee358cd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting a11db41ce25f4dd48d4e2c7456ec4be7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 3305b5a4c5934a1ba8d1a8572d738349, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 00:53:59,126 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 34934efe902145aebe660824009fb58f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 00:53:59,128 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:53:59,129 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:59,131 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512288ea89d38c7e3489cb9f0273b8e20e135 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512288ea89d38c7e3489cb9f0273b8e20e135 2023-11-18 00:53:59,132 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512315c0b1ceb1c9e495a885a59face72cceb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512315c0b1ceb1c9e495a885a59face72cceb 2023-11-18 00:53:59,134 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011ab9adbf57f94cafa138c128bd27ced5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601011ab9adbf57f94cafa138c128bd27ced5 2023-11-18 00:53:59,135 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034003a5ad7e3f414eab702c42f46d4d69 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034003a5ad7e3f414eab702c42f46d4d69 2023-11-18 00:53:59,135 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-18 00:53:59,135 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 00:53:59,135 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:53:59,157 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4c699eeeeaea417afe3f12a85af3bbd0#family1#compaction#34 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:53:59,574 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/d00d6584a05e40a189f9423b2cd5c092 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/d00d6584a05e40a189f9423b2cd5c092 2023-11-18 00:53:59,580 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4c699eeeeaea417afe3f12a85af3bbd0/family1 of 4c699eeeeaea417afe3f12a85af3bbd0 into d00d6584a05e40a189f9423b2cd5c092(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:53:59,581 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:53:59,581 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700268839126; duration=0sec 2023-11-18 00:53:59,581 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:53:59,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c289f526e6e349439f4fafb3ae993880, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/9f3dd773725d44128dbf6ca405c64181, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/f4a82609206c4d5ca9bb2a75d63255e1, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/86f9ea6ee7f745abb6c174dd93c5560e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/4d1817d422a045eca678ab8e604e8a77, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/889fd29b712141d6a61db6b7bd14d998, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c44889e79c5c4bb7a604574bdee358cd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/a11db41ce25f4dd48d4e2c7456ec4be7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/3305b5a4c5934a1ba8d1a8572d738349, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/34934efe902145aebe660824009fb58f_SeqId_44_] to archive 2023-11-18 00:53:59,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:53:59,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c289f526e6e349439f4fafb3ae993880 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c289f526e6e349439f4fafb3ae993880 2023-11-18 00:53:59,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/9f3dd773725d44128dbf6ca405c64181 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/9f3dd773725d44128dbf6ca405c64181 2023-11-18 00:53:59,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/f4a82609206c4d5ca9bb2a75d63255e1 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/f4a82609206c4d5ca9bb2a75d63255e1 2023-11-18 00:53:59,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/86f9ea6ee7f745abb6c174dd93c5560e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/86f9ea6ee7f745abb6c174dd93c5560e 2023-11-18 00:53:59,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/4d1817d422a045eca678ab8e604e8a77 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/4d1817d422a045eca678ab8e604e8a77 2023-11-18 00:53:59,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/889fd29b712141d6a61db6b7bd14d998 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/889fd29b712141d6a61db6b7bd14d998 2023-11-18 00:53:59,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c44889e79c5c4bb7a604574bdee358cd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/c44889e79c5c4bb7a604574bdee358cd 2023-11-18 00:53:59,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/a11db41ce25f4dd48d4e2c7456ec4be7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/a11db41ce25f4dd48d4e2c7456ec4be7 2023-11-18 00:53:59,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/3305b5a4c5934a1ba8d1a8572d738349 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/3305b5a4c5934a1ba8d1a8572d738349 2023-11-18 00:53:59,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/34934efe902145aebe660824009fb58f_SeqId_44_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/34934efe902145aebe660824009fb58f_SeqId_44_ 2023-11-18 00:53:59,973 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057096ac3f3f89461fa5c5cde9d251cc94 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057096ac3f3f89461fa5c5cde9d251cc94 2023-11-18 00:53:59,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:53:59,999 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d507f1a245a492e8c76b1a910121ec7 first=Optional[r1] last=Optional[r2] 2023-11-18 00:53:59,999 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d507f1a245a492e8c76b1a910121ec7}] 2023-11-18 00:54:00,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d507f1a245a492e8c76b1a910121ec7 for inclusion in 4c699eeeeaea417afe3f12a85af3bbd0/family1 2023-11-18 00:54:00,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-18 00:54:00,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:00,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:54:00,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6d507f1a245a492e8c76b1a910121ec7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__dc685pbt6t6g7c3kn8aa1567a1d861hqc2tv3lu6vdovqvlldia63tovp60ebqfa/family1/6d507f1a245a492e8c76b1a910121ec7 2023-11-18 00:54:00,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__dc685pbt6t6g7c3kn8aa1567a1d861hqc2tv3lu6vdovqvlldia63tovp60ebqfa/family1/6d507f1a245a492e8c76b1a910121ec7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/7e004c0eb46f4e2a93c47233838238c3_SeqId_47_ 2023-11-18 00:54:00,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__dc685pbt6t6g7c3kn8aa1567a1d861hqc2tv3lu6vdovqvlldia63tovp60ebqfa/family1/6d507f1a245a492e8c76b1a910121ec7 into 4c699eeeeaea417afe3f12a85af3bbd0/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/7e004c0eb46f4e2a93c47233838238c3_SeqId_47_ - updating store file list. 2023-11-18 00:54:00,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/7e004c0eb46f4e2a93c47233838238c3_SeqId_47_ into 4c699eeeeaea417afe3f12a85af3bbd0/family1 2023-11-18 00:54:00,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__dc685pbt6t6g7c3kn8aa1567a1d861hqc2tv3lu6vdovqvlldia63tovp60ebqfa/family1/6d507f1a245a492e8c76b1a910121ec7 into 4c699eeeeaea417afe3f12a85af3bbd0/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/7e004c0eb46f4e2a93c47233838238c3_SeqId_47_) 2023-11-18 00:54:00,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithWeeklyPolicy__dc685pbt6t6g7c3kn8aa1567a1d861hqc2tv3lu6vdovqvlldia63tovp60ebqfa/family1/6d507f1a245a492e8c76b1a910121ec7 2023-11-18 00:54:00,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 00:54:00,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 00:54:00,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 4c699eeeeaea417afe3f12a85af3bbd0/family1 is initiating minor compaction (all files) 2023-11-18 00:54:00,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@492e8a3a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:00,017 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4c699eeeeaea417afe3f12a85af3bbd0/family1 in testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:54:00,017 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/057b1fb61e274c2c94f65f0cbc400037, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/d00d6584a05e40a189f9423b2cd5c092, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/7e004c0eb46f4e2a93c47233838238c3_SeqId_47_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp, totalSize=176.8 K 2023-11-18 00:54:00,017 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 057b1fb61e274c2c94f65f0cbc400037, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823326 2023-11-18 00:54:00,018 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting d00d6584a05e40a189f9423b2cd5c092, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223326 2023-11-18 00:54:00,018 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 7e004c0eb46f4e2a93c47233838238c3_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223326 2023-11-18 00:54:00,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:54:00,019 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:00,021 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120112fd2e7eaa3240d3a0a84b0a9918b08b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120112fd2e7eaa3240d3a0a84b0a9918b08b 2023-11-18 00:54:00,022 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ba8fdf3fac4947f5bc4f113d364a1cb4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ba8fdf3fac4947f5bc4f113d364a1cb4 2023-11-18 00:54:00,023 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-18 00:54:00,023 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 00:54:00,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:00,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:54:00,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:00,025 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:54:00,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8030 sec 2023-11-18 00:54:00,035 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4c699eeeeaea417afe3f12a85af3bbd0#family1#compaction#35 average throughput is 25.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:00,120 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=265 (was 259) - Thread LEAK? -, OpenFileDescriptor=649 (was 638) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 300), ProcessCount=171 (was 171), AvailableMemoryMB=9373 (was 9492) 2023-11-18 00:54:00,131 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=265, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=171, AvailableMemoryMB=9372 2023-11-18 00:54:00,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 00:54:00,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:00,136 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:54:00,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-18 00:54:00,137 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:54:00,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 00:54:00,139 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:00,139 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:00,141 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2 empty. 2023-11-18 00:54:00,141 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:00,141 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12 empty. 2023-11-18 00:54:00,141 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:00,141 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0 empty. 2023-11-18 00:54:00,142 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:00,142 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:00,142 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-18 00:54:00,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 00:54:00,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 00:54:00,553 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-18 00:54:00,554 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3f9ece8e09cf675d69ecc9cf7ad07ca0, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:00,555 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6051ecb83963c3bda946a4c00690ef12, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:00,555 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9112cf8e9b2718ac97b90a301e29ddd2, NAME => 'testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:00,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 00:54:00,962 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:00,962 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 3f9ece8e09cf675d69ecc9cf7ad07ca0, disabling compactions & flushes 2023-11-18 00:54:00,962 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:00,962 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:00,962 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:00,962 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 6051ecb83963c3bda946a4c00690ef12, disabling compactions & flushes 2023-11-18 00:54:00,962 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. after waiting 0 ms 2023-11-18 00:54:00,962 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:00,962 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:00,963 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 3f9ece8e09cf675d69ecc9cf7ad07ca0: 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. after waiting 0 ms 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:00,963 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 6051ecb83963c3bda946a4c00690ef12: 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 9112cf8e9b2718ac97b90a301e29ddd2, disabling compactions & flushes 2023-11-18 00:54:00,963 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:00,963 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. after waiting 0 ms 2023-11-18 00:54:00,964 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:00,964 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:00,964 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 9112cf8e9b2718ac97b90a301e29ddd2: 2023-11-18 00:54:00,966 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:54:00,967 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700268840967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268840967"}]},"ts":"1700268840967"} 2023-11-18 00:54:00,967 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700268840967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268840967"}]},"ts":"1700268840967"} 2023-11-18 00:54:00,967 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700268840967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268840967"}]},"ts":"1700268840967"} 2023-11-18 00:54:00,970 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 00:54:00,970 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:54:00,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268840970"}]},"ts":"1700268840970"} 2023-11-18 00:54:00,972 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-18 00:54:00,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9112cf8e9b2718ac97b90a301e29ddd2, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6051ecb83963c3bda946a4c00690ef12, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3f9ece8e09cf675d69ecc9cf7ad07ca0, ASSIGN}] 2023-11-18 00:54:00,977 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3f9ece8e09cf675d69ecc9cf7ad07ca0, ASSIGN 2023-11-18 00:54:00,977 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6051ecb83963c3bda946a4c00690ef12, ASSIGN 2023-11-18 00:54:00,977 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9112cf8e9b2718ac97b90a301e29ddd2, ASSIGN 2023-11-18 00:54:00,978 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6051ecb83963c3bda946a4c00690ef12, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:00,978 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3f9ece8e09cf675d69ecc9cf7ad07ca0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:00,978 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9112cf8e9b2718ac97b90a301e29ddd2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:01,130 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9112cf8e9b2718ac97b90a301e29ddd2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:01,130 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=3f9ece8e09cf675d69ecc9cf7ad07ca0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:01,130 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6051ecb83963c3bda946a4c00690ef12, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:01,130 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700268841129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268841129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268841129"}]},"ts":"1700268841129"} 2023-11-18 00:54:01,130 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700268841129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268841129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268841129"}]},"ts":"1700268841129"} 2023-11-18 00:54:01,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700268841129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268841129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268841129"}]},"ts":"1700268841129"} 2023-11-18 00:54:01,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 9112cf8e9b2718ac97b90a301e29ddd2, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:01,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 6051ecb83963c3bda946a4c00690ef12, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:01,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 3f9ece8e09cf675d69ecc9cf7ad07ca0, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:01,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 00:54:01,254 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/.tmp/family1/914fd1af0c6c4ee5b669b9799b9d623d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/914fd1af0c6c4ee5b669b9799b9d623d 2023-11-18 00:54:01,260 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4c699eeeeaea417afe3f12a85af3bbd0/family1 of 4c699eeeeaea417afe3f12a85af3bbd0 into 914fd1af0c6c4ee5b669b9799b9d623d(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:54:01,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:54:01,260 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1700268840017; duration=1sec 2023-11-18 00:54:01,261 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:01,283 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:01,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:01,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9112cf8e9b2718ac97b90a301e29ddd2, NAME => 'testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 00:54:01,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:01,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:01,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:01,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:01,288 INFO [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:01,289 DEBUG [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2/family1 2023-11-18 00:54:01,289 DEBUG [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2/family1 2023-11-18 00:54:01,290 INFO [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9112cf8e9b2718ac97b90a301e29ddd2 columnFamilyName family1 2023-11-18 00:54:01,291 INFO [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] regionserver.HStore(310): Store=9112cf8e9b2718ac97b90a301e29ddd2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:01,291 INFO [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:01,292 DEBUG [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2/family2 2023-11-18 00:54:01,292 DEBUG [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2/family2 2023-11-18 00:54:01,293 INFO [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9112cf8e9b2718ac97b90a301e29ddd2 columnFamilyName family2 2023-11-18 00:54:01,294 INFO [StoreOpener-9112cf8e9b2718ac97b90a301e29ddd2-1] regionserver.HStore(310): Store=9112cf8e9b2718ac97b90a301e29ddd2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:01,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:01,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:01,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:54:01,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:54:01,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:01,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9112cf8e9b2718ac97b90a301e29ddd2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66532054, jitterRate=-0.008595138788223267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:54:01,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9112cf8e9b2718ac97b90a301e29ddd2: 2023-11-18 00:54:01,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2., pid=31, masterSystemTime=1700268841283 2023-11-18 00:54:01,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:01,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:01,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:01,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6051ecb83963c3bda946a4c00690ef12, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 00:54:01,304 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9112cf8e9b2718ac97b90a301e29ddd2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:01,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:01,304 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700268841304"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268841304"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268841304"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268841304"}]},"ts":"1700268841304"} 2023-11-18 00:54:01,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:01,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:01,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:01,306 INFO [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:01,307 DEBUG [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12/family1 2023-11-18 00:54:01,307 DEBUG [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12/family1 2023-11-18 00:54:01,308 INFO [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6051ecb83963c3bda946a4c00690ef12 columnFamilyName family1 2023-11-18 00:54:01,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-11-18 00:54:01,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 9112cf8e9b2718ac97b90a301e29ddd2, server=jenkins-hbase4.apache.org,46287,1700268799711 in 175 msec 2023-11-18 00:54:01,309 INFO [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] regionserver.HStore(310): Store=6051ecb83963c3bda946a4c00690ef12/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:01,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9112cf8e9b2718ac97b90a301e29ddd2, ASSIGN in 333 msec 2023-11-18 00:54:01,309 INFO [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:01,311 DEBUG [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12/family2 2023-11-18 00:54:01,311 DEBUG [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12/family2 2023-11-18 00:54:01,312 INFO [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6051ecb83963c3bda946a4c00690ef12 columnFamilyName family2 2023-11-18 00:54:01,313 INFO [StoreOpener-6051ecb83963c3bda946a4c00690ef12-1] regionserver.HStore(310): Store=6051ecb83963c3bda946a4c00690ef12/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:01,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:01,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:01,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:54:01,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:54:01,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:01,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6051ecb83963c3bda946a4c00690ef12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67848615, jitterRate=0.011023148894309998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:54:01,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6051ecb83963c3bda946a4c00690ef12: 2023-11-18 00:54:01,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12., pid=32, masterSystemTime=1700268841283 2023-11-18 00:54:01,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:01,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:01,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:01,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f9ece8e09cf675d69ecc9cf7ad07ca0, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 00:54:01,322 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6051ecb83963c3bda946a4c00690ef12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:01,322 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700268841322"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268841322"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268841322"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268841322"}]},"ts":"1700268841322"} 2023-11-18 00:54:01,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:01,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:01,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:01,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:01,327 INFO [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:01,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/057b1fb61e274c2c94f65f0cbc400037, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/d00d6584a05e40a189f9423b2cd5c092, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/7e004c0eb46f4e2a93c47233838238c3_SeqId_47_] to archive 2023-11-18 00:54:01,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:01,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=29 2023-11-18 00:54:01,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 6051ecb83963c3bda946a4c00690ef12, server=jenkins-hbase4.apache.org,46287,1700268799711 in 192 msec 2023-11-18 00:54:01,330 DEBUG [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 2023-11-18 00:54:01,330 DEBUG [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 2023-11-18 00:54:01,330 INFO [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f9ece8e09cf675d69ecc9cf7ad07ca0 columnFamilyName family1 2023-11-18 00:54:01,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6051ecb83963c3bda946a4c00690ef12, ASSIGN in 355 msec 2023-11-18 00:54:01,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/057b1fb61e274c2c94f65f0cbc400037 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/057b1fb61e274c2c94f65f0cbc400037 2023-11-18 00:54:01,332 INFO [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] regionserver.HStore(310): Store=3f9ece8e09cf675d69ecc9cf7ad07ca0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:01,332 INFO [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:01,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/d00d6584a05e40a189f9423b2cd5c092 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/d00d6584a05e40a189f9423b2cd5c092 2023-11-18 00:54:01,334 DEBUG [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family2 2023-11-18 00:54:01,334 DEBUG [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family2 2023-11-18 00:54:01,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/7e004c0eb46f4e2a93c47233838238c3_SeqId_47_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/family1/7e004c0eb46f4e2a93c47233838238c3_SeqId_47_ 2023-11-18 00:54:01,335 INFO [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f9ece8e09cf675d69ecc9cf7ad07ca0 columnFamilyName family2 2023-11-18 00:54:01,336 INFO [StoreOpener-3f9ece8e09cf675d69ecc9cf7ad07ca0-1] regionserver.HStore(310): Store=3f9ece8e09cf675d69ecc9cf7ad07ca0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:01,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:01,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:01,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:54:01,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:54:01,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:01,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3f9ece8e09cf675d69ecc9cf7ad07ca0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60736690, jitterRate=-0.094952791929245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:54:01,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3f9ece8e09cf675d69ecc9cf7ad07ca0: 2023-11-18 00:54:01,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0., pid=33, masterSystemTime=1700268841283 2023-11-18 00:54:01,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:01,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:01,346 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=3f9ece8e09cf675d69ecc9cf7ad07ca0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:01,346 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700268841345"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268841345"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268841345"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268841345"}]},"ts":"1700268841345"} 2023-11-18 00:54:01,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=30 2023-11-18 00:54:01,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 3f9ece8e09cf675d69ecc9cf7ad07ca0, server=jenkins-hbase4.apache.org,46287,1700268799711 in 214 msec 2023-11-18 00:54:01,351 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=27 2023-11-18 00:54:01,351 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3f9ece8e09cf675d69ecc9cf7ad07ca0, ASSIGN in 374 msec 2023-11-18 00:54:01,351 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:54:01,352 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268841352"}]},"ts":"1700268841352"} 2023-11-18 00:54:01,353 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-18 00:54:01,355 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:54:01,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2220 sec 2023-11-18 00:54:02,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 00:54:02,242 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-18 00:54:02,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:02,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:02,251 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-18 00:54:02,251 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:02,251 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-18 00:54:02,251 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-18 00:54:02,252 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:02,252 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:02,254 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:02,254 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:02,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:02,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:02,255 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:02,255 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:02,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:02,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:02,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:02,256 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-18 00:54:02,256 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:02,256 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-18 00:54:02,257 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:02,257 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. started... 2023-11-18 00:54:02,261 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9112cf8e9b2718ac97b90a301e29ddd2: 2023-11-18 00:54:02,261 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:02,261 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:54:02,262 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:02,261 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. started... 2023-11-18 00:54:02,262 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:54:02,262 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:02,262 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3f9ece8e09cf675d69ecc9cf7ad07ca0 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-18 00:54:02,262 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. started... 2023-11-18 00:54:02,263 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6051ecb83963c3bda946a4c00690ef12: 2023-11-18 00:54:02,263 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:02,263 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:54:02,677 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118d9f7041e9bc54370928ddf339da434be to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231118d9f7041e9bc54370928ddf339da434be 2023-11-18 00:54:03,083 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/.tmp/family1/63e97707d57e4d0092d6d32d3460ddf5 2023-11-18 00:54:03,089 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/.tmp/family1/63e97707d57e4d0092d6d32d3460ddf5 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/63e97707d57e4d0092d6d32d3460ddf5 2023-11-18 00:54:03,094 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/63e97707d57e4d0092d6d32d3460ddf5, entries=1, sequenceid=5, filesize=4.9 K 2023-11-18 00:54:03,095 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 3f9ece8e09cf675d69ecc9cf7ad07ca0 in 833ms, sequenceid=5, compaction requested=false 2023-11-18 00:54:03,095 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-18 00:54:03,095 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3f9ece8e09cf675d69ecc9cf7ad07ca0: 2023-11-18 00:54:03,095 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:03,096 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:54:03,096 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:54:03,096 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,096 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-18 00:54:03,096 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-18 00:54:03,097 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,097 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:03,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-18 00:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46d078a[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:03,099 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-18 00:54:03,100 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,101 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-18 00:54:03,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-18 00:54:03,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:03,101 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,101 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:03,102 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-18 00:54:03,102 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:03,102 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,102 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-18 00:54:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:03,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-18 00:54:03,105 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-18 00:54:03,105 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:03,105 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:03,105 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,105 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:03,108 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,108 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:03,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,108 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:03,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:03,109 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,110 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:03,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,112 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:03,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-18 00:54:03,113 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-18 00:54:03,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:03,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:03,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:03,113 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,113 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,113 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,113 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:03,113 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:03,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:03,213 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:03,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:03,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:03,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:03,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,220 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-18 00:54:03,220 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:03,220 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-18 00:54:03,220 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-18 00:54:03,221 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,221 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,222 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,222 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:03,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:03,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:03,222 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:03,222 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:03,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,223 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,224 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-18 00:54:03,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:03,224 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-18 00:54:03,224 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:03,224 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-18 00:54:03,224 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:03,224 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:03,224 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. started... 2023-11-18 00:54:03,224 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. started... 2023-11-18 00:54:03,224 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9112cf8e9b2718ac97b90a301e29ddd2: 2023-11-18 00:54:03,224 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3f9ece8e09cf675d69ecc9cf7ad07ca0 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-18 00:54:03,224 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:54:03,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:54:03,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:03,225 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:03,225 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. started... 2023-11-18 00:54:03,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:54:03,225 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6051ecb83963c3bda946a4c00690ef12: 2023-11-18 00:54:03,225 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:54:03,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:54:03,642 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311182802ef7ab08c4860983ba7b93e6f6a64 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311182802ef7ab08c4860983ba7b93e6f6a64 2023-11-18 00:54:04,048 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/.tmp/family1/e4f47ab7a5454c0fbbee899132d0eba6 2023-11-18 00:54:04,054 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/.tmp/family1/e4f47ab7a5454c0fbbee899132d0eba6 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/e4f47ab7a5454c0fbbee899132d0eba6 2023-11-18 00:54:04,058 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/e4f47ab7a5454c0fbbee899132d0eba6, entries=2, sequenceid=9, filesize=5.0 K 2023-11-18 00:54:04,059 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 3f9ece8e09cf675d69ecc9cf7ad07ca0 in 835ms, sequenceid=9, compaction requested=false 2023-11-18 00:54:04,059 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3f9ece8e09cf675d69ecc9cf7ad07ca0: 2023-11-18 00:54:04,059 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:54:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:54:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-18 00:54:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-18 00:54:04,061 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,061 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:04,062 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,062 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:04,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:04,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-18 00:54:04,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7283c547[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:04,063 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-18 00:54:04,064 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,066 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,066 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-18 00:54:04,066 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-18 00:54:04,066 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:04,066 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,066 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:04,067 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-18 00:54:04,067 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:04,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-18 00:54:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:04,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:04,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:04,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-18 00:54:04,070 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-18 00:54:04,070 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:04,070 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:04,070 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,070 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:04,073 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,073 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:04,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:04,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,073 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:04,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:04,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:04,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:04,074 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:04,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,075 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:04,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,081 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,081 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,081 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:04,082 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:04,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-18 00:54:04,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:04,082 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:04,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:04,082 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:04,082 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:04,082 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,082 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,082 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:04,082 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,082 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:04,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:04,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:04,182 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:04,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:04,190 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-18 00:54:04,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-18 00:54:04,192 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-18 00:54:04,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:04,193 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269444193 2023-11-18 00:54:04,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:54:04,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-18 00:54:04,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-18 00:54:04,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x07e297b1 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:04,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f398d17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:04,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-18 00:54:05,031 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118ed09a692702949a39d64c6c24b2c191c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231118ed09a692702949a39d64c6c24b2c191c 2023-11-18 00:54:05,031 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-18 00:54:05,045 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:54:05,046 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:54:05,054 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:54:05,056 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:54:05,066 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118/family1/8b17fd9103604b1f8f2e364d7a2658ba first=Optional[k0] last=Optional[k1] 2023-11-18 00:54:05,067 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118/family1/8b17fd9103604b1f8f2e364d7a2658ba}] 2023-11-18 00:54:05,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118/family1/8b17fd9103604b1f8f2e364d7a2658ba for inclusion in 3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 2023-11-18 00:54:05,095 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:05,095 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35ad6ef1 to 127.0.0.1:58527 2023-11-18 00:54:05,096 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:05,097 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:05,097 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25d9d3ea to 127.0.0.1:58527 2023-11-18 00:54:05,097 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:05,097 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:05,097 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3eef9e3b to 127.0.0.1:58527 2023-11-18 00:54:05,097 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:05,097 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:05,097 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6862b413 to 127.0.0.1:58527 2023-11-18 00:54:05,097 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:05,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-18 00:54:05,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 00:54:05,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 3f9ece8e09cf675d69ecc9cf7ad07ca0: 2023-11-18 00:54:05,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118/family1/8b17fd9103604b1f8f2e364d7a2658ba to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testScannerOnBulkLoadRefHFiles__nnlchgmvvmmhfedmcvj49vhtrovqmv7l5j2vrsl65sroquh5edh9uqhig69kd0vt/family1/8b17fd9103604b1f8f2e364d7a2658ba 2023-11-18 00:54:05,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testScannerOnBulkLoadRefHFiles__nnlchgmvvmmhfedmcvj49vhtrovqmv7l5j2vrsl65sroquh5edh9uqhig69kd0vt/family1/8b17fd9103604b1f8f2e364d7a2658ba as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_ 2023-11-18 00:54:05,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testScannerOnBulkLoadRefHFiles__nnlchgmvvmmhfedmcvj49vhtrovqmv7l5j2vrsl65sroquh5edh9uqhig69kd0vt/family1/8b17fd9103604b1f8f2e364d7a2658ba into 3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_ - updating store file list. 2023-11-18 00:54:05,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_ into 3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 2023-11-18 00:54:05,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testScannerOnBulkLoadRefHFiles__nnlchgmvvmmhfedmcvj49vhtrovqmv7l5j2vrsl65sroquh5edh9uqhig69kd0vt/family1/8b17fd9103604b1f8f2e364d7a2658ba into 3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_) 2023-11-18 00:54:05,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testScannerOnBulkLoadRefHFiles__nnlchgmvvmmhfedmcvj49vhtrovqmv7l5j2vrsl65sroquh5edh9uqhig69kd0vt/family1/8b17fd9103604b1f8f2e364d7a2658ba 2023-11-18 00:54:05,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 00:54:05,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 00:54:05,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 is initiating minor compaction (all files) 2023-11-18 00:54:05,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7d1b1046; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:05,112 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 in testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:54:05,113 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/63e97707d57e4d0092d6d32d3460ddf5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/e4f47ab7a5454c0fbbee899132d0eba6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/.tmp, totalSize=15.1 K 2023-11-18 00:54:05,113 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 63e97707d57e4d0092d6d32d3460ddf5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268842242 2023-11-18 00:54:05,114 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting e4f47ab7a5454c0fbbee899132d0eba6, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268842242 2023-11-18 00:54:05,114 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268842242 2023-11-18 00:54:05,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-18 00:54:05,116 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:05,118 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311182802ef7ab08c4860983ba7b93e6f6a64 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311182802ef7ab08c4860983ba7b93e6f6a64 2023-11-18 00:54:05,119 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231118d9f7041e9bc54370928ddf339da434be to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231118d9f7041e9bc54370928ddf339da434be 2023-11-18 00:54:05,119 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-18 00:54:05,119 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 00:54:05,120 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-18 00:54:05,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-18 00:54:05,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:05,121 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-18 00:54:05,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 930 msec 2023-11-18 00:54:05,125 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3f9ece8e09cf675d69ecc9cf7ad07ca0#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:05,160 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=263 (was 265), OpenFileDescriptor=632 (was 649), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 262), ProcessCount=169 (was 171), AvailableMemoryMB=9300 (was 9372) 2023-11-18 00:54:05,171 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=263, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=169, AvailableMemoryMB=9300 2023-11-18 00:54:05,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 00:54:05,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:05,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:54:05,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-18 00:54:05,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:54:05,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 00:54:05,177 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,177 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b empty. 2023-11-18 00:54:05,178 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,178 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-18 00:54:05,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 00:54:05,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 00:54:05,586 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-18 00:54:05,587 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => d45a160b99171bc2adfe82921961420b, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:05,592 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:05,592 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing d45a160b99171bc2adfe82921961420b, disabling compactions & flushes 2023-11-18 00:54:05,593 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:05,593 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:05,593 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. after waiting 0 ms 2023-11-18 00:54:05,593 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:05,593 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:05,593 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:05,595 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:54:05,596 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700268845596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268845596"}]},"ts":"1700268845596"} 2023-11-18 00:54:05,597 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:54:05,598 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:54:05,598 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268845598"}]},"ts":"1700268845598"} 2023-11-18 00:54:05,599 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-18 00:54:05,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=d45a160b99171bc2adfe82921961420b, ASSIGN}] 2023-11-18 00:54:05,605 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=d45a160b99171bc2adfe82921961420b, ASSIGN 2023-11-18 00:54:05,605 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=d45a160b99171bc2adfe82921961420b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:05,756 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d45a160b99171bc2adfe82921961420b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:05,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700268845756"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268845756"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268845756"}]},"ts":"1700268845756"} 2023-11-18 00:54:05,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure d45a160b99171bc2adfe82921961420b, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:05,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 00:54:05,909 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:05,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:05,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d45a160b99171bc2adfe82921961420b, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:54:05,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:05,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,914 INFO [StoreOpener-d45a160b99171bc2adfe82921961420b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,916 DEBUG [StoreOpener-d45a160b99171bc2adfe82921961420b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1 2023-11-18 00:54:05,916 DEBUG [StoreOpener-d45a160b99171bc2adfe82921961420b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1 2023-11-18 00:54:05,916 INFO [StoreOpener-d45a160b99171bc2adfe82921961420b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d45a160b99171bc2adfe82921961420b columnFamilyName family1 2023-11-18 00:54:05,917 INFO [StoreOpener-d45a160b99171bc2adfe82921961420b-1] regionserver.HStore(310): Store=d45a160b99171bc2adfe82921961420b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:05,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d45a160b99171bc2adfe82921961420b 2023-11-18 00:54:05,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:05,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d45a160b99171bc2adfe82921961420b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60561274, jitterRate=-0.09756669402122498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:54:05,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:05,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b., pid=37, masterSystemTime=1700268845909 2023-11-18 00:54:05,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:05,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:05,926 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d45a160b99171bc2adfe82921961420b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:05,927 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700268845926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268845926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268845926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268845926"}]},"ts":"1700268845926"} 2023-11-18 00:54:05,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-18 00:54:05,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure d45a160b99171bc2adfe82921961420b, server=jenkins-hbase4.apache.org,46287,1700268799711 in 170 msec 2023-11-18 00:54:05,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-18 00:54:05,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=d45a160b99171bc2adfe82921961420b, ASSIGN in 326 msec 2023-11-18 00:54:05,932 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:54:05,932 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268845932"}]},"ts":"1700268845932"} 2023-11-18 00:54:05,933 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-18 00:54:05,935 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:54:05,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 762 msec 2023-11-18 00:54:06,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 00:54:06,280 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-18 00:54:06,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:06,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,308 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:06,308 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:06,308 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:06,308 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:06,308 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,309 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,310 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:06,310 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:06,311 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,311 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,312 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:06,312 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:06,312 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:06,313 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 00:54:06,331 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a90dc7118bed4fbf80aae5b348782ca6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130a90dc7118bed4fbf80aae5b348782ca6 2023-11-18 00:54:06,343 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/.tmp/family1/aeba0f8cf0ba41da9a61b6996a88d077 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/aeba0f8cf0ba41da9a61b6996a88d077 2023-11-18 00:54:06,347 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3f9ece8e09cf675d69ecc9cf7ad07ca0/family1 of 3f9ece8e09cf675d69ecc9cf7ad07ca0 into aeba0f8cf0ba41da9a61b6996a88d077(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:54:06,347 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3f9ece8e09cf675d69ecc9cf7ad07ca0: 2023-11-18 00:54:06,348 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1700268845112; duration=1sec 2023-11-18 00:54:06,348 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:06,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/63e97707d57e4d0092d6d32d3460ddf5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/e4f47ab7a5454c0fbbee899132d0eba6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_] to archive 2023-11-18 00:54:06,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:06,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/63e97707d57e4d0092d6d32d3460ddf5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/63e97707d57e4d0092d6d32d3460ddf5 2023-11-18 00:54:06,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/e4f47ab7a5454c0fbbee899132d0eba6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/e4f47ab7a5454c0fbbee899132d0eba6 2023-11-18 00:54:06,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/family1/9d50d9b399c1404d9a81f40cd5e31cb8_SeqId_12_ 2023-11-18 00:54:06,735 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/812993bcfc9d4ef29efe41b97a9d19f9 2023-11-18 00:54:06,740 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/812993bcfc9d4ef29efe41b97a9d19f9 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/812993bcfc9d4ef29efe41b97a9d19f9 2023-11-18 00:54:06,744 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/812993bcfc9d4ef29efe41b97a9d19f9, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-18 00:54:06,745 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 432ms, sequenceid=5, compaction requested=false 2023-11-18 00:54:06,745 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:06,746 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:06,746 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:06,748 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,748 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:06,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:06,749 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,749 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:06,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:06,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:06,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:06,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:06,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c0fa8de[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:06,751 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:06,751 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,752 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,752 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:06,752 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:06,752 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:06,752 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,753 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:06,754 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:06,754 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:06,754 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,754 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:06,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:06,757 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:06,757 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:06,757 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:06,757 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,757 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:06,759 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:06,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:06,759 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,760 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:06,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:06,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:06,760 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,762 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:06,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 00:54:06,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:06,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:06,766 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:06,766 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:06,818 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:54:06,867 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:06,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:06,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:06,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:06,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,873 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:06,873 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:06,873 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:06,873 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:06,873 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,873 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,875 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,875 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:06,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:06,875 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:06,875 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,876 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,876 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:06,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:06,876 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:06,876 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:06,876 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:06,876 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:06,877 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:06,877 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:06,877 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:06,877 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 00:54:06,890 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c9223f893c604e00a26352e50a9d7996 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128c9223f893c604e00a26352e50a9d7996 2023-11-18 00:54:07,299 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/e58c6dfac323485ca9c7f65f5e31ac43 2023-11-18 00:54:07,304 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/e58c6dfac323485ca9c7f65f5e31ac43 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/e58c6dfac323485ca9c7f65f5e31ac43 2023-11-18 00:54:07,308 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/e58c6dfac323485ca9c7f65f5e31ac43, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 00:54:07,309 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 432ms, sequenceid=9, compaction requested=false 2023-11-18 00:54:07,309 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:07,309 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:07,309 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:07,309 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:07,309 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,309 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:07,309 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:07,311 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,311 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:07,311 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,311 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:07,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71e903d7[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:07,312 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:07,313 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,314 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:07,314 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,314 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:07,316 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:07,316 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,316 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:07,316 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:07,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:07,318 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:07,318 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:07,318 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:07,318 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,318 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:07,320 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,320 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:07,320 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:07,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:07,321 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,322 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,328 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,329 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:07,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:07,329 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:07,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:07,429 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:07,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:07,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:07,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:07,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,435 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:07,435 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:07,436 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:07,436 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:07,436 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,436 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,438 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:07,438 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:07,439 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,439 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:07,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,439 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,439 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:07,440 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:07,440 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:07,440 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:07,440 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:07,440 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:07,440 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:07,440 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:07,440 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:07,852 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d4337c718754426faba4e6187f49c3ae to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d4337c718754426faba4e6187f49c3ae 2023-11-18 00:54:08,257 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/455623b596bf4e73b445a3c8d785b0cb 2023-11-18 00:54:08,262 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/455623b596bf4e73b445a3c8d785b0cb as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/455623b596bf4e73b445a3c8d785b0cb 2023-11-18 00:54:08,266 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/455623b596bf4e73b445a3c8d785b0cb, entries=1, sequenceid=13, filesize=4.9 K 2023-11-18 00:54:08,267 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 827ms, sequenceid=13, compaction requested=true 2023-11-18 00:54:08,267 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:08,267 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:08,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:08,269 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,269 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:08,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:08,270 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,270 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:08,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:08,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:08,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:08,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dd40b37[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:08,271 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:08,271 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,272 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,272 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:08,272 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:08,273 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:08,273 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,273 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:08,274 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,274 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:08,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:08,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:08,274 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:08,274 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:08,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:08,276 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:08,276 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:08,277 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:08,277 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,277 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:08,280 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,280 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:08,280 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:08,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:08,280 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,282 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,284 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,284 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,284 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:08,284 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:08,284 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,285 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:08,284 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:08,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 00:54:08,285 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,285 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:08,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:08,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:08,285 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,285 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:08,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:08,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:08,285 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:08,385 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:08,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:08,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:08,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:08,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,391 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:08,391 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:08,391 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:08,391 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:08,392 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,392 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,393 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:08,393 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:08,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:08,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,394 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,395 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:08,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:08,395 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:08,395 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:08,395 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:08,395 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:08,395 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:08,395 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:08,395 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:08,395 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:08,807 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c6440cd374b84226875d12aee9822baa to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c6440cd374b84226875d12aee9822baa 2023-11-18 00:54:09,213 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/7aa5bbbbaa9c491994edb4c4fc20b3e4 2023-11-18 00:54:09,218 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/7aa5bbbbaa9c491994edb4c4fc20b3e4 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/7aa5bbbbaa9c491994edb4c4fc20b3e4 2023-11-18 00:54:09,222 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/7aa5bbbbaa9c491994edb4c4fc20b3e4, entries=1, sequenceid=17, filesize=4.9 K 2023-11-18 00:54:09,223 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 828ms, sequenceid=17, compaction requested=true 2023-11-18 00:54:09,223 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:09,223 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:09,223 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:09,223 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:09,223 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,223 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:09,223 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:09,226 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,226 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:09,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:09,226 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,227 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71115c37[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:09,228 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:09,228 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,230 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:09,230 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,230 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:09,231 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:09,232 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:09,234 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:09,234 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:09,234 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:09,234 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,234 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:09,236 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,236 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:09,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,236 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:09,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:09,236 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,238 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:09,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:09,240 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:09,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:09,241 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:09,241 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:09,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:09,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:09,341 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:09,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:09,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:09,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:09,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,347 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:09,347 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:09,347 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:09,347 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:09,347 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,347 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,349 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,349 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:09,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:09,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:09,350 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:09,350 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:09,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,350 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,351 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:09,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:09,351 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:09,351 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:09,351 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:09,351 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:09,763 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281e95785f3e24483f9d9e814f7d557aa4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512281e95785f3e24483f9d9e814f7d557aa4 2023-11-18 00:54:10,169 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/6f857400e4af4a7d89b919861273033f 2023-11-18 00:54:10,174 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/6f857400e4af4a7d89b919861273033f as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/6f857400e4af4a7d89b919861273033f 2023-11-18 00:54:10,178 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/6f857400e4af4a7d89b919861273033f, entries=1, sequenceid=21, filesize=4.9 K 2023-11-18 00:54:10,179 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 828ms, sequenceid=21, compaction requested=true 2023-11-18 00:54:10,179 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:10,179 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:10,182 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,182 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:10,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:10,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10b94393[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:10,183 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:10,183 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,185 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:10,185 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:10,185 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,185 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:10,186 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,186 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,187 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:10,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:10,189 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:10,189 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:10,189 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:10,189 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,189 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:10,195 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,195 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,195 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:10,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:10,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:10,195 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,197 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,199 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:10,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:10,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,199 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:10,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:10,200 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:10,200 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:10,300 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:10,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:10,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:10,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:10,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,306 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:10,306 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:10,306 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:10,306 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:10,307 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,307 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,308 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,308 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:10,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:10,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:10,309 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:10,309 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:10,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:10,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,309 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,310 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:10,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:10,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:10,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:10,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:10,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:10,310 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:10,310 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:10,310 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:10,310 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:10,722 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311533138d3a0c4639bf61e6de37d0ab71 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311533138d3a0c4639bf61e6de37d0ab71 2023-11-18 00:54:11,128 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/20864f6e3c0340c594dea3321e9f3e99 2023-11-18 00:54:11,132 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/20864f6e3c0340c594dea3321e9f3e99 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/20864f6e3c0340c594dea3321e9f3e99 2023-11-18 00:54:11,136 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/20864f6e3c0340c594dea3321e9f3e99, entries=1, sequenceid=25, filesize=4.9 K 2023-11-18 00:54:11,137 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 827ms, sequenceid=25, compaction requested=true 2023-11-18 00:54:11,137 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:11,137 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:11,137 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:11,137 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:11,137 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,137 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:11,137 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:11,139 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,139 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:11,139 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,139 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:11,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:11,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29771de8[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:11,141 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:11,141 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,143 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,144 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:11,144 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:11,144 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:11,144 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,144 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:11,145 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:11,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:11,148 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:11,148 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:11,148 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:11,148 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,148 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:11,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:11,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:11,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:11,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:11,150 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:11,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:11,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,151 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,153 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:11,154 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:11,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:11,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:11,154 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:11,254 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:11,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:11,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:11,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:11,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,260 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:11,260 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:11,260 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:11,260 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:11,261 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,261 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,263 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,263 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:11,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:11,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:11,264 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,264 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,264 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:11,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,265 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:11,265 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:11,265 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:11,265 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:11,265 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:11,265 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:11,265 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:11,265 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:11,276 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f0f7daca03d34040b9c43fc7d435da11 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0f7daca03d34040b9c43fc7d435da11 2023-11-18 00:54:11,681 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/8284decdc33d4d0bace21a726cca47e2 2023-11-18 00:54:11,686 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/8284decdc33d4d0bace21a726cca47e2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/8284decdc33d4d0bace21a726cca47e2 2023-11-18 00:54:11,690 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/8284decdc33d4d0bace21a726cca47e2, entries=1, sequenceid=29, filesize=4.9 K 2023-11-18 00:54:11,691 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 426ms, sequenceid=29, compaction requested=true 2023-11-18 00:54:11,691 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:11,691 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:11,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:11,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:11,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:11,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:11,693 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:11,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:11,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:11,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:11,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14473642[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:11,695 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:11,695 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,696 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,697 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:11,697 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:11,697 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:11,697 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,697 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:11,699 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:11,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,699 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:11,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:11,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:11,699 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:11,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:11,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:11,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:11,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:11,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:11,702 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:11,702 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:11,702 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:11,702 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,702 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:11,704 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,704 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:11,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:11,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,704 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:11,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:11,705 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:11,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,706 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:11,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,708 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:11,709 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:11,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:11,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:11,709 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:11,809 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:11,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:11,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:11,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:11,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,816 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:11,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:11,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:11,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:11,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,816 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,817 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,817 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:11,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:11,818 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:11,818 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:11,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,819 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:11,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:11,819 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:11,819 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:11,819 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:11,819 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:11,819 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:11,819 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:11,819 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:11,819 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:12,232 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a283d77116714563afad920f4ea5d7a3 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a283d77116714563afad920f4ea5d7a3 2023-11-18 00:54:12,637 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/d22e54d45ad3463bab596dec16cb8b53 2023-11-18 00:54:12,642 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/d22e54d45ad3463bab596dec16cb8b53 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/d22e54d45ad3463bab596dec16cb8b53 2023-11-18 00:54:12,645 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/d22e54d45ad3463bab596dec16cb8b53, entries=1, sequenceid=33, filesize=4.9 K 2023-11-18 00:54:12,646 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 827ms, sequenceid=33, compaction requested=true 2023-11-18 00:54:12,646 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:12,646 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:12,646 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:12,646 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:12,646 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,646 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:12,646 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:12,648 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,648 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:12,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:12,649 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,649 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:12,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:12,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:12,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:12,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:12,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f4c2019[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:12,650 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:12,650 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,655 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,655 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:12,655 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:12,655 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:12,655 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,656 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:12,657 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:12,659 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:12,659 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:12,659 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:12,659 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,660 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:12,662 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,662 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:12,662 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:12,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:12,662 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,663 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,667 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,667 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:12,667 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:12,667 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:12,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:12,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:12,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:12,667 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,668 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 00:54:12,667 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:12,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:12,668 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:12,668 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:12,668 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,668 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:12,668 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,768 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:12,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:12,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:12,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:12,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,774 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:12,774 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:12,774 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:12,774 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:12,775 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,775 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,777 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:12,777 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:12,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:12,778 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:12,778 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:12,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:12,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,778 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,779 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:12,779 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:12,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:12,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:12,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:12,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:12,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:12,779 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:12,779 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:12,779 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:13,191 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075490202e04c740ab9a80f5d7b5c99790 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509075490202e04c740ab9a80f5d7b5c99790 2023-11-18 00:54:13,597 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/92b2989396824660b940d3e49387081a 2023-11-18 00:54:13,602 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/92b2989396824660b940d3e49387081a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/92b2989396824660b940d3e49387081a 2023-11-18 00:54:13,606 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/92b2989396824660b940d3e49387081a, entries=1, sequenceid=37, filesize=4.9 K 2023-11-18 00:54:13,606 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 827ms, sequenceid=37, compaction requested=true 2023-11-18 00:54:13,606 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:13,607 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:13,607 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:13,607 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:13,607 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,607 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:13,607 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:13,608 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,608 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:13,609 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,609 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:13,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:13,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35b343b8[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:13,610 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:13,610 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,612 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:13,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:13,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:13,612 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,612 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:13,613 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:13,613 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:13,613 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,613 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:13,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:13,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:13,616 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:13,616 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:13,616 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:13,616 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,616 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:13,618 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,618 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:13,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:13,618 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:13,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:13,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:13,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:13,619 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:13,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,620 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:13,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:13,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:13,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:13,623 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:13,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:13,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:13,723 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:13,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:13,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:13,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:13,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,731 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:13,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:13,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 00:54:13,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 00:54:13,732 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,732 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,733 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:13,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:13,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:13,734 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,735 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:13,735 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:13,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,735 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 00:54:13,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 00:54:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 00:54:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:13,736 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:13,736 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:13,736 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. started... 2023-11-18 00:54:13,737 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d45a160b99171bc2adfe82921961420b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:14,164 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ccff350ce1c942098ec93ccbb0a6c9af to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120ccff350ce1c942098ec93ccbb0a6c9af 2023-11-18 00:54:14,569 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/dba912d6ce2d436e9f00790dbcc4d67d 2023-11-18 00:54:14,574 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/dba912d6ce2d436e9f00790dbcc4d67d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/dba912d6ce2d436e9f00790dbcc4d67d 2023-11-18 00:54:14,579 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/dba912d6ce2d436e9f00790dbcc4d67d, entries=1, sequenceid=41, filesize=4.9 K 2023-11-18 00:54:14,579 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d45a160b99171bc2adfe82921961420b in 842ms, sequenceid=41, compaction requested=true 2023-11-18 00:54:14,579 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:14,579 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:14,579 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:14,580 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:14,580 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,580 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 00:54:14,580 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 00:54:14,581 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,581 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:14,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:14,582 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,582 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:14,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:14,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:14,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:14,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 00:54:14,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@243a90bb[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:14,583 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 00:54:14,583 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,584 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,585 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 00:54:14,585 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 00:54:14,585 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:14,585 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,585 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:14,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 00:54:14,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:14,587 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 00:54:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:14,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:14,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:54:14,590 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 00:54:14,590 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:14,590 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:14,590 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,590 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:14,591 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,591 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:14,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,591 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:14,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:14,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:14,592 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,593 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 00:54:14,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,598 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:14,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:14,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 00:54:14,599 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:14,598 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,599 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:14,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:14,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:14,699 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:14,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:14,701 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-18 00:54:14,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:54:14,703 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:54:14,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:14,704 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269454704 2023-11-18 00:54:14,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:54:14,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-18 00:54:14,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:54:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x082f052a to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:14,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b3d600d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:14,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,550 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010375fcbb7d655d4010b4eb9ed572ad12b5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010375fcbb7d655d4010b4eb9ed572ad12b5 2023-11-18 00:54:15,551 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:54:15,565 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:54:15,566 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:54:15,572 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:54:15,573 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:54:15,581 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1413fecadb744281b1c93ae38706cf0c first=Optional[r3] last=Optional[r6] 2023-11-18 00:54:15,581 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1413fecadb744281b1c93ae38706cf0c}] 2023-11-18 00:54:15,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1413fecadb744281b1c93ae38706cf0c for inclusion in d45a160b99171bc2adfe82921961420b/family1 2023-11-18 00:54:15,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 00:54:15,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:15,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:15,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1413fecadb744281b1c93ae38706cf0c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3it9mmfj2ph8b3are62dhrfqgaftfnq8g6lttia955julij75s6f5ve6kgganjmi/family1/1413fecadb744281b1c93ae38706cf0c 2023-11-18 00:54:15,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3it9mmfj2ph8b3are62dhrfqgaftfnq8g6lttia955julij75s6f5ve6kgganjmi/family1/1413fecadb744281b1c93ae38706cf0c as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_ 2023-11-18 00:54:15,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3it9mmfj2ph8b3are62dhrfqgaftfnq8g6lttia955julij75s6f5ve6kgganjmi/family1/1413fecadb744281b1c93ae38706cf0c into d45a160b99171bc2adfe82921961420b/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_ - updating store file list. 2023-11-18 00:54:15,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_ into d45a160b99171bc2adfe82921961420b/family1 2023-11-18 00:54:15,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3it9mmfj2ph8b3are62dhrfqgaftfnq8g6lttia955julij75s6f5ve6kgganjmi/family1/1413fecadb744281b1c93ae38706cf0c into d45a160b99171bc2adfe82921961420b/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_) 2023-11-18 00:54:15,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3it9mmfj2ph8b3are62dhrfqgaftfnq8g6lttia955julij75s6f5ve6kgganjmi/family1/1413fecadb744281b1c93ae38706cf0c 2023-11-18 00:54:15,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 00:54:15,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 00:54:15,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): d45a160b99171bc2adfe82921961420b/family1 is initiating minor compaction 2023-11-18 00:54:15,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d1f2651; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:15,599 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d45a160b99171bc2adfe82921961420b/family1 in testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:15,600 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/e58c6dfac323485ca9c7f65f5e31ac43, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/455623b596bf4e73b445a3c8d785b0cb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/7aa5bbbbaa9c491994edb4c4fc20b3e4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/6f857400e4af4a7d89b919861273033f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/20864f6e3c0340c594dea3321e9f3e99, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/8284decdc33d4d0bace21a726cca47e2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/d22e54d45ad3463bab596dec16cb8b53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/92b2989396824660b940d3e49387081a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/dba912d6ce2d436e9f00790dbcc4d67d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp, totalSize=50.0 K 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting e58c6dfac323485ca9c7f65f5e31ac43, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 455623b596bf4e73b445a3c8d785b0cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 7aa5bbbbaa9c491994edb4c4fc20b3e4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 6f857400e4af4a7d89b919861273033f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 20864f6e3c0340c594dea3321e9f3e99, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 8284decdc33d4d0bace21a726cca47e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting d22e54d45ad3463bab596dec16cb8b53, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 92b2989396824660b940d3e49387081a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting dba912d6ce2d436e9f00790dbcc4d67d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 00:54:15,600 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 00:54:15,601 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:54:15,602 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:15,604 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512281e95785f3e24483f9d9e814f7d557aa4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512281e95785f3e24483f9d9e814f7d557aa4 2023-11-18 00:54:15,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311533138d3a0c4639bf61e6de37d0ab71 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311533138d3a0c4639bf61e6de37d0ab71 2023-11-18 00:54:15,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0f7daca03d34040b9c43fc7d435da11 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0f7daca03d34040b9c43fc7d435da11 2023-11-18 00:54:15,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a283d77116714563afad920f4ea5d7a3 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a283d77116714563afad920f4ea5d7a3 2023-11-18 00:54:15,609 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-18 00:54:15,609 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 00:54:15,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:15,639 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): d45a160b99171bc2adfe82921961420b#family1#compaction#49 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:16,454 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/00a7f9c66cd54cea812fb8a0c888dba2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/00a7f9c66cd54cea812fb8a0c888dba2 2023-11-18 00:54:16,459 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d45a160b99171bc2adfe82921961420b/family1 of d45a160b99171bc2adfe82921961420b into 00a7f9c66cd54cea812fb8a0c888dba2(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:54:16,459 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:16,460 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700268855599; duration=0sec 2023-11-18 00:54:16,460 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:16,464 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205410fe8a6b4f147d38ed75b1a40127cbb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205410fe8a6b4f147d38ed75b1a40127cbb 2023-11-18 00:54:16,465 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:54:16,490 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92eae9a4f36f48edb4fa8651cd768f46 first=Optional[r00] last=Optional[r2] 2023-11-18 00:54:16,490 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92eae9a4f36f48edb4fa8651cd768f46}] 2023-11-18 00:54:16,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92eae9a4f36f48edb4fa8651cd768f46 for inclusion in d45a160b99171bc2adfe82921961420b/family1 2023-11-18 00:54:16,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-18 00:54:16,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:16,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:16,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/92eae9a4f36f48edb4fa8651cd768f46 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sjhmbjo8q1lghgvk657pr9sotu1o53cpd7058g362hrd3bqp78dd16eggg6c6him/family1/92eae9a4f36f48edb4fa8651cd768f46 2023-11-18 00:54:16,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sjhmbjo8q1lghgvk657pr9sotu1o53cpd7058g362hrd3bqp78dd16eggg6c6him/family1/92eae9a4f36f48edb4fa8651cd768f46 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/23399b9fa20147cebed1151c53635f45_SeqId_47_ 2023-11-18 00:54:16,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sjhmbjo8q1lghgvk657pr9sotu1o53cpd7058g362hrd3bqp78dd16eggg6c6him/family1/92eae9a4f36f48edb4fa8651cd768f46 into d45a160b99171bc2adfe82921961420b/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/23399b9fa20147cebed1151c53635f45_SeqId_47_ - updating store file list. 2023-11-18 00:54:16,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/23399b9fa20147cebed1151c53635f45_SeqId_47_ into d45a160b99171bc2adfe82921961420b/family1 2023-11-18 00:54:16,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sjhmbjo8q1lghgvk657pr9sotu1o53cpd7058g362hrd3bqp78dd16eggg6c6him/family1/92eae9a4f36f48edb4fa8651cd768f46 into d45a160b99171bc2adfe82921961420b/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/23399b9fa20147cebed1151c53635f45_SeqId_47_) 2023-11-18 00:54:16,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sjhmbjo8q1lghgvk657pr9sotu1o53cpd7058g362hrd3bqp78dd16eggg6c6him/family1/92eae9a4f36f48edb4fa8651cd768f46 2023-11-18 00:54:16,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 00:54:16,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 00:54:16,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): d45a160b99171bc2adfe82921961420b/family1 is initiating minor compaction (all files) 2023-11-18 00:54:16,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@8980f13; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:16,503 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d45a160b99171bc2adfe82921961420b/family1 in testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:54:16,503 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/812993bcfc9d4ef29efe41b97a9d19f9, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/00a7f9c66cd54cea812fb8a0c888dba2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/23399b9fa20147cebed1151c53635f45_SeqId_47_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp, totalSize=337.0 K 2023-11-18 00:54:16,504 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 812993bcfc9d4ef29efe41b97a9d19f9, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823326 2023-11-18 00:54:16,504 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 00a7f9c66cd54cea812fb8a0c888dba2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223326 2023-11-18 00:54:16,505 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 23399b9fa20147cebed1151c53635f45_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823326 2023-11-18 00:54:16,505 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:54:16,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:16,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130a90dc7118bed4fbf80aae5b348782ca6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130a90dc7118bed4fbf80aae5b348782ca6 2023-11-18 00:54:16,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d4337c718754426faba4e6187f49c3ae to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d4337c718754426faba4e6187f49c3ae 2023-11-18 00:54:16,510 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c6440cd374b84226875d12aee9822baa to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c6440cd374b84226875d12aee9822baa 2023-11-18 00:54:16,510 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-18 00:54:16,510 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 00:54:16,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 00:54:16,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 00:54:16,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:16,511 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:54:16,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8100 sec 2023-11-18 00:54:16,526 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): d45a160b99171bc2adfe82921961420b#family1#compaction#50 average throughput is 12.89 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:16,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/e58c6dfac323485ca9c7f65f5e31ac43, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/455623b596bf4e73b445a3c8d785b0cb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/7aa5bbbbaa9c491994edb4c4fc20b3e4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/6f857400e4af4a7d89b919861273033f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/20864f6e3c0340c594dea3321e9f3e99, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/8284decdc33d4d0bace21a726cca47e2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/d22e54d45ad3463bab596dec16cb8b53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/92b2989396824660b940d3e49387081a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/dba912d6ce2d436e9f00790dbcc4d67d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_] to archive 2023-11-18 00:54:16,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:16,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/e58c6dfac323485ca9c7f65f5e31ac43 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/e58c6dfac323485ca9c7f65f5e31ac43 2023-11-18 00:54:16,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/455623b596bf4e73b445a3c8d785b0cb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/455623b596bf4e73b445a3c8d785b0cb 2023-11-18 00:54:16,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/7aa5bbbbaa9c491994edb4c4fc20b3e4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/7aa5bbbbaa9c491994edb4c4fc20b3e4 2023-11-18 00:54:16,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/6f857400e4af4a7d89b919861273033f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/6f857400e4af4a7d89b919861273033f 2023-11-18 00:54:16,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/20864f6e3c0340c594dea3321e9f3e99 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/20864f6e3c0340c594dea3321e9f3e99 2023-11-18 00:54:16,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/8284decdc33d4d0bace21a726cca47e2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/8284decdc33d4d0bace21a726cca47e2 2023-11-18 00:54:16,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/d22e54d45ad3463bab596dec16cb8b53 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/d22e54d45ad3463bab596dec16cb8b53 2023-11-18 00:54:16,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/92b2989396824660b940d3e49387081a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/92b2989396824660b940d3e49387081a 2023-11-18 00:54:16,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/dba912d6ce2d436e9f00790dbcc4d67d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/dba912d6ce2d436e9f00790dbcc4d67d 2023-11-18 00:54:16,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/f2dfa7b51da0476da36fb3f03e7f32b7_SeqId_44_ 2023-11-18 00:54:16,562 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-11-18 00:54:16,620 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=263 (was 263), OpenFileDescriptor=648 (was 632) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 241), ProcessCount=169 (was 169), AvailableMemoryMB=9292 (was 9300) 2023-11-18 00:54:16,631 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=263, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=169, AvailableMemoryMB=9291 2023-11-18 00:54:16,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 00:54:16,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:16,635 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:54:16,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-18 00:54:16,636 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:54:16,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 00:54:16,637 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:16,638 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a empty. 2023-11-18 00:54:16,638 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:16,638 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-18 00:54:16,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 00:54:16,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 00:54:17,046 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-18 00:54:17,047 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79a29bcf437c750e54c6d5f8e605ce5a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:17,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 00:54:17,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:17,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 79a29bcf437c750e54c6d5f8e605ce5a, disabling compactions & flushes 2023-11-18 00:54:17,453 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:17,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:17,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. after waiting 0 ms 2023-11-18 00:54:17,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:17,453 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:17,453 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:17,455 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:54:17,456 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268857456"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268857456"}]},"ts":"1700268857456"} 2023-11-18 00:54:17,457 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:54:17,458 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:54:17,458 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268857458"}]},"ts":"1700268857458"} 2023-11-18 00:54:17,459 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-18 00:54:17,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, ASSIGN}] 2023-11-18 00:54:17,464 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, ASSIGN 2023-11-18 00:54:17,465 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:17,616 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:17,616 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268857616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268857616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268857616"}]},"ts":"1700268857616"} 2023-11-18 00:54:17,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:17,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 00:54:17,769 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:17,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:17,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79a29bcf437c750e54c6d5f8e605ce5a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:54:17,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:17,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:17,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:17,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:17,773 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/.tmp/family1/b74fec3b068449e38be92c49409a5995 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/b74fec3b068449e38be92c49409a5995 2023-11-18 00:54:17,778 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d45a160b99171bc2adfe82921961420b/family1 of d45a160b99171bc2adfe82921961420b into b74fec3b068449e38be92c49409a5995(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:54:17,778 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:54:17,778 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1700268856503; duration=1sec 2023-11-18 00:54:17,778 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:17,779 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:17,780 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:17,780 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:17,780 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79a29bcf437c750e54c6d5f8e605ce5a columnFamilyName family1 2023-11-18 00:54:17,782 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(310): Store=79a29bcf437c750e54c6d5f8e605ce5a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:17,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:17,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:17,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:17,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:17,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79a29bcf437c750e54c6d5f8e605ce5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68905308, jitterRate=0.02676910161972046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:54:17,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:17,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a., pid=41, masterSystemTime=1700268857769 2023-11-18 00:54:17,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:17,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:17,789 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:17,789 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268857789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268857789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268857789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268857789"}]},"ts":"1700268857789"} 2023-11-18 00:54:17,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-18 00:54:17,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711 in 174 msec 2023-11-18 00:54:17,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-18 00:54:17,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, ASSIGN in 329 msec 2023-11-18 00:54:17,794 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:54:17,794 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268857794"}]},"ts":"1700268857794"} 2023-11-18 00:54:17,795 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-18 00:54:17,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:54:17,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1650 sec 2023-11-18 00:54:17,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/812993bcfc9d4ef29efe41b97a9d19f9, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/00a7f9c66cd54cea812fb8a0c888dba2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/23399b9fa20147cebed1151c53635f45_SeqId_47_] to archive 2023-11-18 00:54:17,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:17,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/812993bcfc9d4ef29efe41b97a9d19f9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/812993bcfc9d4ef29efe41b97a9d19f9 2023-11-18 00:54:17,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/00a7f9c66cd54cea812fb8a0c888dba2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/00a7f9c66cd54cea812fb8a0c888dba2 2023-11-18 00:54:17,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/23399b9fa20147cebed1151c53635f45_SeqId_47_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/family1/23399b9fa20147cebed1151c53635f45_SeqId_47_ 2023-11-18 00:54:18,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 00:54:18,741 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-18 00:54:18,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:18,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:18,766 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:18,766 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:18,766 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:18,766 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:18,766 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:18,766 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:18,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:18,770 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:18,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:18,771 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:18,771 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:18,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:18,771 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:18,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:18,772 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:18,772 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:18,772 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:18,773 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 00:54:19,192 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113070a34973579c44dda678f3fc6df30cc8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113070a34973579c44dda678f3fc6df30cc8 2023-11-18 00:54:19,596 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/4c3cb0f2762b45a49186052a6ee80ec4 2023-11-18 00:54:19,601 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/4c3cb0f2762b45a49186052a6ee80ec4 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/4c3cb0f2762b45a49186052a6ee80ec4 2023-11-18 00:54:19,605 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/4c3cb0f2762b45a49186052a6ee80ec4, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-18 00:54:19,606 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 833ms, sequenceid=5, compaction requested=false 2023-11-18 00:54:19,606 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:19,606 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:19,606 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:19,606 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:19,606 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:19,606 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,606 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:19,606 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:19,608 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,608 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:19,609 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,609 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:19,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:19,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9e25758[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:19,610 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:19,610 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,612 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:19,612 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,612 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:19,614 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,614 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:19,614 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:19,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,614 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:19,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:19,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:19,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:19,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:19,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:19,616 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:19,616 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:19,616 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:19,616 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,616 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:19,619 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,619 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:19,619 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:19,620 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:19,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:19,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,621 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,623 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:19,624 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:19,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:19,624 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,624 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:19,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:19,624 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:19,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:19,624 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,624 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:19,624 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,624 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:19,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:19,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:19,724 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:19,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:19,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:19,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:19,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,730 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:19,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:19,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:19,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:19,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,732 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,732 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:19,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:19,732 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,733 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:19,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:19,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,733 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,733 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:19,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,734 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:19,734 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:19,734 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:19,734 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:19,734 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:19,734 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:19,734 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:19,734 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 00:54:19,748 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112809dc6638e9534ccebef71a7cc6179c2f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112809dc6638e9534ccebef71a7cc6179c2f 2023-11-18 00:54:19,753 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/9d4548a7a7114844acef9c4aa7337113 2023-11-18 00:54:19,757 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/9d4548a7a7114844acef9c4aa7337113 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9d4548a7a7114844acef9c4aa7337113 2023-11-18 00:54:19,760 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9d4548a7a7114844acef9c4aa7337113, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 00:54:19,761 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 27ms, sequenceid=9, compaction requested=false 2023-11-18 00:54:19,761 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:19,761 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:19,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:19,763 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,763 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:19,764 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,764 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:19,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:19,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@720e295[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:19,765 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:19,765 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,767 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:19,767 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,767 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:19,767 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:19,767 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:19,769 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:19,769 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,769 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,769 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:19,771 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:19,772 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:19,772 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:19,772 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,772 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:19,774 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,774 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:19,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,774 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:19,774 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,776 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:19,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:19,783 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:19,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:19,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:19,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:19,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:19,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:19,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:19,783 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,784 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,884 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:19,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:19,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:19,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:19,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,890 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:19,890 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:19,890 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:19,890 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:19,890 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,890 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,893 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,893 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:19,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:19,893 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:19,893 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,894 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,894 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:19,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:19,894 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:19,895 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:19,895 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:19,895 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:19,895 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:19,895 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:19,895 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:19,895 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:20,306 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120150a1f8beb1644e02a69f143289796eb2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120150a1f8beb1644e02a69f143289796eb2 2023-11-18 00:54:20,712 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/413914c79a6f414b8cd17337db4f4f54 2023-11-18 00:54:20,717 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/413914c79a6f414b8cd17337db4f4f54 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/413914c79a6f414b8cd17337db4f4f54 2023-11-18 00:54:20,721 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/413914c79a6f414b8cd17337db4f4f54, entries=1, sequenceid=13, filesize=5.0 K 2023-11-18 00:54:20,722 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 827ms, sequenceid=13, compaction requested=true 2023-11-18 00:54:20,722 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:20,722 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:20,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:20,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:20,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:20,722 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:20,724 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,724 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:20,724 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,724 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28a1cf4a[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:20,726 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:20,726 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,727 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,727 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:20,727 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:20,728 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:20,728 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,728 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:20,729 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,729 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:20,729 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:20,729 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:20,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:20,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:20,731 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:20,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:20,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:20,731 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,731 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:20,733 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,733 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:20,733 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:20,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:20,734 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:20,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,735 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:20,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:20,738 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:20,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:20,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:20,738 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:20,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:20,838 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:20,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:20,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:20,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:20,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,844 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:20,844 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:20,844 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:20,844 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:20,845 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,845 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,846 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:20,846 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:20,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:20,846 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:20,846 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:20,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:20,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,847 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,847 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:20,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:20,847 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:20,847 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:20,847 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:20,847 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:20,847 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:20,848 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:20,848 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:20,848 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:21,260 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205de392cc83fab44e89b976d11e66ea574 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205de392cc83fab44e89b976d11e66ea574 2023-11-18 00:54:21,666 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/983fe93a16ec4926be536df926346895 2023-11-18 00:54:21,670 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/983fe93a16ec4926be536df926346895 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/983fe93a16ec4926be536df926346895 2023-11-18 00:54:21,674 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/983fe93a16ec4926be536df926346895, entries=1, sequenceid=17, filesize=5.0 K 2023-11-18 00:54:21,675 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 827ms, sequenceid=17, compaction requested=true 2023-11-18 00:54:21,675 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:21,675 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:21,675 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:21,675 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:21,675 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,675 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:21,675 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:21,677 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,677 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:21,678 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,678 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:21,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:21,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@586e3dad[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:21,679 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:21,679 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,682 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,682 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:21,682 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:21,682 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:21,682 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,682 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:21,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:21,683 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:21,683 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:21,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:21,686 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:21,686 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:21,686 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:21,686 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,686 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:21,687 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,687 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:21,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:21,687 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:21,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:21,688 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,689 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:21,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:21,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:21,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 00:54:21,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,692 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:21,692 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:21,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:21,691 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:21,692 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:21,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:21,692 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:21,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:21,792 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:21,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:21,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:21,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:21,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,798 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:21,798 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:21,798 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:21,798 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:21,798 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,798 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,801 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:21,801 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:21,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:21,801 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:21,801 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:21,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:21,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,802 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,802 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:21,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:21,802 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:21,802 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:21,802 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:21,802 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:21,802 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:21,802 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:21,802 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:21,802 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:22,214 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281f1e1b0adcc9438aab1438fb6390180d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281f1e1b0adcc9438aab1438fb6390180d 2023-11-18 00:54:22,620 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/386dde60b7be4b9292f20921969ee081 2023-11-18 00:54:22,624 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/386dde60b7be4b9292f20921969ee081 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/386dde60b7be4b9292f20921969ee081 2023-11-18 00:54:22,628 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/386dde60b7be4b9292f20921969ee081, entries=1, sequenceid=21, filesize=5.0 K 2023-11-18 00:54:22,629 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 827ms, sequenceid=21, compaction requested=true 2023-11-18 00:54:22,629 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:22,629 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:22,629 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:22,629 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:22,629 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,629 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:22,629 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:22,634 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:22,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:22,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43adf96f[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:22,636 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:22,636 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,638 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,638 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:22,638 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:22,638 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:22,638 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,638 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:22,639 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:22,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:22,642 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:22,642 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:22,642 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:22,642 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,642 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:22,643 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,643 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,644 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:22,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:22,644 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,646 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,648 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,648 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,648 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,648 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:22,649 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:22,649 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:22,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 00:54:22,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:22,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:22,649 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,649 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:22,649 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,649 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,649 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:22,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:22,649 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:22,749 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:22,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:22,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:22,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:22,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,755 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:22,755 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:22,755 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:22,755 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:22,756 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,756 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,758 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:22,758 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:22,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:22,759 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:22,759 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:22,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,760 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,760 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:22,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:22,760 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:22,760 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:22,760 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:22,760 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:22,760 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:22,760 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:22,760 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:22,760 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:23,173 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316831001df36f417cb5d96e3ca933bf29 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512316831001df36f417cb5d96e3ca933bf29 2023-11-18 00:54:23,304 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:54:23,579 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/8353a1d543994e46b3b54cfd9db73ac0 2023-11-18 00:54:23,583 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/8353a1d543994e46b3b54cfd9db73ac0 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/8353a1d543994e46b3b54cfd9db73ac0 2023-11-18 00:54:23,587 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/8353a1d543994e46b3b54cfd9db73ac0, entries=1, sequenceid=25, filesize=5.0 K 2023-11-18 00:54:23,588 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 828ms, sequenceid=25, compaction requested=true 2023-11-18 00:54:23,588 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:23,588 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:23,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:23,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:23,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:23,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:23,590 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,590 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:23,590 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,590 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:23,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:23,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:23,591 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:23,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43999fc5[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:23,591 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,592 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:23,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:23,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:23,593 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,593 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:23,595 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:23,595 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,595 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:23,595 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:23,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:23,598 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:23,598 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:23,598 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:23,598 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,598 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:23,599 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,599 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:23,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:23,599 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:23,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,600 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:23,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:23,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:23,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:23,601 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:23,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,603 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,604 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:23,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:23,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:23,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:23,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 00:54:23,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:23,604 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:23,704 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:23,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:23,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:23,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:23,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,711 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:23,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:23,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:23,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:23,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,712 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,712 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:23,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:23,713 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:23,713 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:23,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:23,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:23,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:23,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:23,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:23,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:23,714 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:23,714 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:23,714 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:24,127 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101cbe4a3e9d00c41bd90765cb4e33f32f2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101cbe4a3e9d00c41bd90765cb4e33f32f2 2023-11-18 00:54:24,532 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/2964f1f9aa464abd823e5a0c98c55fc4 2023-11-18 00:54:24,536 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/2964f1f9aa464abd823e5a0c98c55fc4 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/2964f1f9aa464abd823e5a0c98c55fc4 2023-11-18 00:54:24,540 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/2964f1f9aa464abd823e5a0c98c55fc4, entries=1, sequenceid=29, filesize=5.0 K 2023-11-18 00:54:24,541 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 827ms, sequenceid=29, compaction requested=true 2023-11-18 00:54:24,541 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:24,541 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:24,541 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:24,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:24,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:24,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:24,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,544 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:24,544 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,544 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6564c363[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:24,546 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:24,546 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,547 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:24,547 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,547 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:24,551 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:24,551 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:24,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,551 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:24,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:24,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:24,556 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:24,556 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:24,556 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:24,556 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,556 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:24,558 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,558 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,558 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:24,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:24,558 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,559 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:24,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:24,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:24,562 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:24,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 00:54:24,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:24,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:24,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,562 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,563 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:24,563 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:24,663 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:24,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:24,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:24,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:24,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,668 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:24,668 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:24,668 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:24,668 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:24,669 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,669 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,670 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:24,670 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:24,671 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:24,671 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,672 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:24,672 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:24,672 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:24,672 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:24,672 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:24,672 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:24,672 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:24,672 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:24,672 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:24,672 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:25,084 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037fa6ed52c11f4372acebb4a08159ee51 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601037fa6ed52c11f4372acebb4a08159ee51 2023-11-18 00:54:25,490 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/ea7e23756f8b4dc8943064991c07e6f2 2023-11-18 00:54:25,494 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/ea7e23756f8b4dc8943064991c07e6f2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ea7e23756f8b4dc8943064991c07e6f2 2023-11-18 00:54:25,498 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ea7e23756f8b4dc8943064991c07e6f2, entries=1, sequenceid=33, filesize=5.0 K 2023-11-18 00:54:25,499 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 827ms, sequenceid=33, compaction requested=true 2023-11-18 00:54:25,499 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:25,499 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:25,499 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:25,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:25,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:25,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:25,502 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,502 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:25,503 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,503 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:25,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:25,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cce0937[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:25,504 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:25,504 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,505 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,505 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:25,505 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:25,505 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:25,506 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,506 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:25,507 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:25,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:25,509 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:25,509 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:25,509 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:25,509 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,510 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:25,511 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,511 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:25,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,511 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:25,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:25,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:25,512 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:25,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,513 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,516 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,516 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:25,516 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:25,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 00:54:25,516 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:25,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:25,516 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:25,516 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:25,517 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:25,516 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:25,517 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,517 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:25,517 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,517 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:25,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:25,617 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:25,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:25,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:25,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:25,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,623 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:25,623 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:25,623 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:25,623 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:25,624 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,624 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,625 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,625 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:25,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:25,626 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:25,626 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,626 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,627 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:25,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:25,627 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:25,627 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:25,627 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:25,627 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:26,041 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072276760deb1a4a26a60cf3308485a357 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509072276760deb1a4a26a60cf3308485a357 2023-11-18 00:54:26,447 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/ac73c2293f9c4ea19179ccaf1397bf64 2023-11-18 00:54:26,451 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/ac73c2293f9c4ea19179ccaf1397bf64 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ac73c2293f9c4ea19179ccaf1397bf64 2023-11-18 00:54:26,455 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ac73c2293f9c4ea19179ccaf1397bf64, entries=1, sequenceid=37, filesize=5.0 K 2023-11-18 00:54:26,456 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 829ms, sequenceid=37, compaction requested=true 2023-11-18 00:54:26,456 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:26,456 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:26,456 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:26,456 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:26,456 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,456 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:26,456 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:26,458 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:26,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:26,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:26,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6004f740[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:26,460 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:26,460 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,461 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,461 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:26,461 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:26,461 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:26,461 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,461 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:26,463 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:26,464 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:26,463 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,464 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:26,466 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:26,466 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:26,466 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:26,466 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,466 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:26,467 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,467 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:26,467 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:26,468 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,469 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:26,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:26,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,475 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:26,475 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:26,576 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:26,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:26,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:26,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:26,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,582 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:26,582 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:26,582 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 00:54:26,582 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 00:54:26,582 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,582 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,585 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,585 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:26,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:26,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:26,585 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:26,585 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:26,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:26,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,586 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,586 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 00:54:26,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:26,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 00:54:26,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 00:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:26,587 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:26,587 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. started... 2023-11-18 00:54:26,587 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 79a29bcf437c750e54c6d5f8e605ce5a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:26,601 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112020283273efed414f806fc92ee095e841 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112020283273efed414f806fc92ee095e841 2023-11-18 00:54:27,006 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/6c587a2095bf4225adf596d2b3dd9ee0 2023-11-18 00:54:27,011 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/6c587a2095bf4225adf596d2b3dd9ee0 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/6c587a2095bf4225adf596d2b3dd9ee0 2023-11-18 00:54:27,015 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/6c587a2095bf4225adf596d2b3dd9ee0, entries=1, sequenceid=41, filesize=5.0 K 2023-11-18 00:54:27,016 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 79a29bcf437c750e54c6d5f8e605ce5a in 429ms, sequenceid=41, compaction requested=true 2023-11-18 00:54:27,016 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:27,016 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:27,016 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:27,016 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:27,016 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,016 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 00:54:27,016 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 00:54:27,018 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:27,018 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:27,018 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,018 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:27,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 00:54:27,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f6c2b32[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:27,020 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 00:54:27,020 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,021 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,021 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 00:54:27,021 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 00:54:27,021 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,021 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:27,021 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:27,023 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,023 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 00:54:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:27,023 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:27,023 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 00:54:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:27,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 00:54:27,026 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 00:54:27,026 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:27,026 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:27,026 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,026 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:27,030 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,030 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:27,031 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:27,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:27,031 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,032 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:27,035 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:27,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 00:54:27,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 00:54:27,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:27,035 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:27,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:27,136 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:27,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:27,137 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:27,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:27,139 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:27,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:27,140 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269467140 2023-11-18 00:54:27,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:54:27,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-18 00:54:27,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:27,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x23bd709c to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:27,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32041ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:27,149 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:27,984 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039a04da5da9a3433e940e7edff0790d73 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039a04da5da9a3433e940e7edff0790d73 2023-11-18 00:54:27,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:27,999 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:54:28,000 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:54:28,005 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:54:28,007 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:54:28,015 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4419606707864f1baf85c859e5186490 first=Optional[r3] last=Optional[r6] 2023-11-18 00:54:28,015 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4419606707864f1baf85c859e5186490}] 2023-11-18 00:54:28,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4419606707864f1baf85c859e5186490 for inclusion in 79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:28,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 00:54:28,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:28,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:28,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4419606707864f1baf85c859e5186490 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2j85cpn99u8ij2n9o92povj83br6k02rvbjqmg6l5hjcqlsmcghv5eclfljf6hor/family1/4419606707864f1baf85c859e5186490 2023-11-18 00:54:28,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2j85cpn99u8ij2n9o92povj83br6k02rvbjqmg6l5hjcqlsmcghv5eclfljf6hor/family1/4419606707864f1baf85c859e5186490 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/11c6708357a340c6b4c8bb550ffdac36_SeqId_44_ 2023-11-18 00:54:28,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2j85cpn99u8ij2n9o92povj83br6k02rvbjqmg6l5hjcqlsmcghv5eclfljf6hor/family1/4419606707864f1baf85c859e5186490 into 79a29bcf437c750e54c6d5f8e605ce5a/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/11c6708357a340c6b4c8bb550ffdac36_SeqId_44_ - updating store file list. 2023-11-18 00:54:28,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/11c6708357a340c6b4c8bb550ffdac36_SeqId_44_ into 79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:28,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2j85cpn99u8ij2n9o92povj83br6k02rvbjqmg6l5hjcqlsmcghv5eclfljf6hor/family1/4419606707864f1baf85c859e5186490 into 79a29bcf437c750e54c6d5f8e605ce5a/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/11c6708357a340c6b4c8bb550ffdac36_SeqId_44_) 2023-11-18 00:54:28,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2j85cpn99u8ij2n9o92povj83br6k02rvbjqmg6l5hjcqlsmcghv5eclfljf6hor/family1/4419606707864f1baf85c859e5186490 2023-11-18 00:54:28,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 00:54:28,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 00:54:28,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 79a29bcf437c750e54c6d5f8e605ce5a/family1 is initiating minor compaction 2023-11-18 00:54:28,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6b382f77; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:28,034 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 79a29bcf437c750e54c6d5f8e605ce5a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:28,034 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9d4548a7a7114844acef9c4aa7337113, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/413914c79a6f414b8cd17337db4f4f54, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/983fe93a16ec4926be536df926346895, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/386dde60b7be4b9292f20921969ee081, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/8353a1d543994e46b3b54cfd9db73ac0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/2964f1f9aa464abd823e5a0c98c55fc4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ea7e23756f8b4dc8943064991c07e6f2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ac73c2293f9c4ea19179ccaf1397bf64, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/6c587a2095bf4225adf596d2b3dd9ee0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/11c6708357a340c6b4c8bb550ffdac36_SeqId_44_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp, totalSize=50.4 K 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 9d4548a7a7114844acef9c4aa7337113, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 413914c79a6f414b8cd17337db4f4f54, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 983fe93a16ec4926be536df926346895, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 386dde60b7be4b9292f20921969ee081, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 8353a1d543994e46b3b54cfd9db73ac0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 2964f1f9aa464abd823e5a0c98c55fc4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting ea7e23756f8b4dc8943064991c07e6f2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting ac73c2293f9c4ea19179ccaf1397bf64, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 6c587a2095bf4225adf596d2b3dd9ee0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 00:54:28,034 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 11c6708357a340c6b4c8bb550ffdac36_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 00:54:28,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:28,037 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:28,038 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281f1e1b0adcc9438aab1438fb6390180d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512281f1e1b0adcc9438aab1438fb6390180d 2023-11-18 00:54:28,039 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512316831001df36f417cb5d96e3ca933bf29 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512316831001df36f417cb5d96e3ca933bf29 2023-11-18 00:54:28,041 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101cbe4a3e9d00c41bd90765cb4e33f32f2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101cbe4a3e9d00c41bd90765cb4e33f32f2 2023-11-18 00:54:28,042 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601037fa6ed52c11f4372acebb4a08159ee51 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601037fa6ed52c11f4372acebb4a08159ee51 2023-11-18 00:54:28,042 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-18 00:54:28,042 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 00:54:28,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,066 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 79a29bcf437c750e54c6d5f8e605ce5a#family1#compaction#61 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:28,492 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/3d7e2660bf1e4ac791c2c45637214d54 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/3d7e2660bf1e4ac791c2c45637214d54 2023-11-18 00:54:28,498 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 79a29bcf437c750e54c6d5f8e605ce5a/family1 of 79a29bcf437c750e54c6d5f8e605ce5a into 3d7e2660bf1e4ac791c2c45637214d54(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:54:28,498 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:28,498 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700268868034; duration=0sec 2023-11-18 00:54:28,498 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:28,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9d4548a7a7114844acef9c4aa7337113, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/413914c79a6f414b8cd17337db4f4f54, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/983fe93a16ec4926be536df926346895, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/386dde60b7be4b9292f20921969ee081, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/8353a1d543994e46b3b54cfd9db73ac0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/2964f1f9aa464abd823e5a0c98c55fc4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ea7e23756f8b4dc8943064991c07e6f2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ac73c2293f9c4ea19179ccaf1397bf64, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/6c587a2095bf4225adf596d2b3dd9ee0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/11c6708357a340c6b4c8bb550ffdac36_SeqId_44_] to archive 2023-11-18 00:54:28,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:28,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9d4548a7a7114844acef9c4aa7337113 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9d4548a7a7114844acef9c4aa7337113 2023-11-18 00:54:28,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/413914c79a6f414b8cd17337db4f4f54 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/413914c79a6f414b8cd17337db4f4f54 2023-11-18 00:54:28,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/983fe93a16ec4926be536df926346895 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/983fe93a16ec4926be536df926346895 2023-11-18 00:54:28,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/386dde60b7be4b9292f20921969ee081 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/386dde60b7be4b9292f20921969ee081 2023-11-18 00:54:28,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/8353a1d543994e46b3b54cfd9db73ac0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/8353a1d543994e46b3b54cfd9db73ac0 2023-11-18 00:54:28,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/2964f1f9aa464abd823e5a0c98c55fc4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/2964f1f9aa464abd823e5a0c98c55fc4 2023-11-18 00:54:28,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ea7e23756f8b4dc8943064991c07e6f2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ea7e23756f8b4dc8943064991c07e6f2 2023-11-18 00:54:28,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ac73c2293f9c4ea19179ccaf1397bf64 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/ac73c2293f9c4ea19179ccaf1397bf64 2023-11-18 00:54:28,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/6c587a2095bf4225adf596d2b3dd9ee0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/6c587a2095bf4225adf596d2b3dd9ee0 2023-11-18 00:54:28,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/11c6708357a340c6b4c8bb550ffdac36_SeqId_44_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/11c6708357a340c6b4c8bb550ffdac36_SeqId_44_ 2023-11-18 00:54:28,892 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120573ceff70bfa842dfabd3248e4b554659 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120573ceff70bfa842dfabd3248e4b554659 2023-11-18 00:54:28,893 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:28,916 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c4d6e7423edf44c4a9ec891d3050dedc first=Optional[r00] last=Optional[r2] 2023-11-18 00:54:28,916 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c4d6e7423edf44c4a9ec891d3050dedc}] 2023-11-18 00:54:28,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c4d6e7423edf44c4a9ec891d3050dedc for inclusion in 79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:28,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-18 00:54:28,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:28,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:28,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c4d6e7423edf44c4a9ec891d3050dedc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v4hmqbqk3v2l4vdnec28tb499eb75agnnpvbcntrr1lijdua73jeg0svrgpsienr/family1/c4d6e7423edf44c4a9ec891d3050dedc 2023-11-18 00:54:28,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v4hmqbqk3v2l4vdnec28tb499eb75agnnpvbcntrr1lijdua73jeg0svrgpsienr/family1/c4d6e7423edf44c4a9ec891d3050dedc as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/54c605dd526a444bb454370948dda529_SeqId_47_ 2023-11-18 00:54:28,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v4hmqbqk3v2l4vdnec28tb499eb75agnnpvbcntrr1lijdua73jeg0svrgpsienr/family1/c4d6e7423edf44c4a9ec891d3050dedc into 79a29bcf437c750e54c6d5f8e605ce5a/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/54c605dd526a444bb454370948dda529_SeqId_47_ - updating store file list. 2023-11-18 00:54:28,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/54c605dd526a444bb454370948dda529_SeqId_47_ into 79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:28,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v4hmqbqk3v2l4vdnec28tb499eb75agnnpvbcntrr1lijdua73jeg0svrgpsienr/family1/c4d6e7423edf44c4a9ec891d3050dedc into 79a29bcf437c750e54c6d5f8e605ce5a/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/54c605dd526a444bb454370948dda529_SeqId_47_) 2023-11-18 00:54:28,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v4hmqbqk3v2l4vdnec28tb499eb75agnnpvbcntrr1lijdua73jeg0svrgpsienr/family1/c4d6e7423edf44c4a9ec891d3050dedc 2023-11-18 00:54:28,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 00:54:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 00:54:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 79a29bcf437c750e54c6d5f8e605ce5a/family1 is initiating minor compaction (all files) 2023-11-18 00:54:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@718553e0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:28,931 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 79a29bcf437c750e54c6d5f8e605ce5a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:28,932 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/4c3cb0f2762b45a49186052a6ee80ec4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/3d7e2660bf1e4ac791c2c45637214d54, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/54c605dd526a444bb454370948dda529_SeqId_47_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp, totalSize=390.1 K 2023-11-18 00:54:28,932 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 4c3cb0f2762b45a49186052a6ee80ec4, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823326 2023-11-18 00:54:28,932 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 3d7e2660bf1e4ac791c2c45637214d54, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223326 2023-11-18 00:54:28,933 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 54c605dd526a444bb454370948dda529_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823326 2023-11-18 00:54:28,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:28,934 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:28,935 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113070a34973579c44dda678f3fc6df30cc8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113070a34973579c44dda678f3fc6df30cc8 2023-11-18 00:54:28,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120150a1f8beb1644e02a69f143289796eb2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120150a1f8beb1644e02a69f143289796eb2 2023-11-18 00:54:28,937 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205de392cc83fab44e89b976d11e66ea574 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205de392cc83fab44e89b976d11e66ea574 2023-11-18 00:54:28,937 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-18 00:54:28,937 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 00:54:28,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:28,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:28,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:28,939 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:28,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8010 sec 2023-11-18 00:54:28,947 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 79a29bcf437c750e54c6d5f8e605ce5a#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:29,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 00:54:29,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:29,022 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-18 00:54:29,023 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-18 00:54:29,023 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-18 00:54:29,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-18 00:54:29,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, REOPEN/MOVE}] 2023-11-18 00:54:29,028 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, REOPEN/MOVE 2023-11-18 00:54:29,028 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:29,028 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268869028"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268869028"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268869028"}]},"ts":"1700268869028"} 2023-11-18 00:54:29,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:29,181 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:29,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:29,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79a29bcf437c750e54c6d5f8e605ce5a, disabling compactions & flushes 2023-11-18 00:54:29,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:29,764 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/.tmp/family1/9a768c228dff44f6a1b5a7880d4ac6e2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9a768c228dff44f6a1b5a7880d4ac6e2 2023-11-18 00:54:29,768 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 79a29bcf437c750e54c6d5f8e605ce5a/family1 of 79a29bcf437c750e54c6d5f8e605ce5a into 9a768c228dff44f6a1b5a7880d4ac6e2(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:54:29,768 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:29,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:29,769 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1700268868931; duration=0sec 2023-11-18 00:54:29,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:29,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. after waiting 0 ms 2023-11-18 00:54:29,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:29,769 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:29,770 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/4c3cb0f2762b45a49186052a6ee80ec4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/3d7e2660bf1e4ac791c2c45637214d54, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/54c605dd526a444bb454370948dda529_SeqId_47_] to archive 2023-11-18 00:54:29,771 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:29,772 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/4c3cb0f2762b45a49186052a6ee80ec4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/4c3cb0f2762b45a49186052a6ee80ec4 2023-11-18 00:54:29,774 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/3d7e2660bf1e4ac791c2c45637214d54 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/3d7e2660bf1e4ac791c2c45637214d54 2023-11-18 00:54:29,775 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/54c605dd526a444bb454370948dda529_SeqId_47_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/54c605dd526a444bb454370948dda529_SeqId_47_ 2023-11-18 00:54:29,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 00:54:29,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:29,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:29,780 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 79a29bcf437c750e54c6d5f8e605ce5a to self. 2023-11-18 00:54:29,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:29,782 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=CLOSED 2023-11-18 00:54:29,782 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268869782"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268869782"}]},"ts":"1700268869782"} 2023-11-18 00:54:29,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-18 00:54:29,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711 in 753 msec 2023-11-18 00:54:29,785 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=true 2023-11-18 00:54:29,936 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:29,936 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268869936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268869936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268869936"}]},"ts":"1700268869936"} 2023-11-18 00:54:29,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:30,089 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:30,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79a29bcf437c750e54c6d5f8e605ce5a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:54:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:30,093 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:30,094 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:30,094 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:30,094 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79a29bcf437c750e54c6d5f8e605ce5a columnFamilyName family1 2023-11-18 00:54:30,099 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9a768c228dff44f6a1b5a7880d4ac6e2 2023-11-18 00:54:30,099 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(310): Store=79a29bcf437c750e54c6d5f8e605ce5a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:30,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:30,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:30,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:30,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79a29bcf437c750e54c6d5f8e605ce5a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71009603, jitterRate=0.05812554061412811}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:54:30,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:30,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a., pid=47, masterSystemTime=1700268870089 2023-11-18 00:54:30,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:30,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:30,107 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:30,107 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268870107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268870107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268870107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268870107"}]},"ts":"1700268870107"} 2023-11-18 00:54:30,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-18 00:54:30,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711 in 172 msec 2023-11-18 00:54:30,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-18 00:54:30,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, REOPEN/MOVE in 1.0830 sec 2023-11-18 00:54:30,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-18 00:54:30,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0880 sec 2023-11-18 00:54:30,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1020 sec 2023-11-18 00:54:30,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-18 00:54:30,116 INFO [Listener at localhost/41175] compactions.TestMobCompactor(278): alter status finished 2023-11-18 00:54:30,117 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:30,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:30,118 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:30,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:30,119 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269470119 2023-11-18 00:54:30,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:54:30,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-18 00:54:30,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:30,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x64ea5d4a to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:30,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65444f08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:30,126 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:30,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:30,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:30,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:30,127 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:30,951 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289b73f2ffafe3441b8088cfd5109c5e9f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511289b73f2ffafe3441b8088cfd5109c5e9f 2023-11-18 00:54:30,951 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:30,964 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:54:30,965 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:54:30,971 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:54:30,972 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:54:30,980 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68efd9be697b4f2c8825a4b30848c99b first=Optional[r05] last=Optional[r8] 2023-11-18 00:54:30,980 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68efd9be697b4f2c8825a4b30848c99b}] 2023-11-18 00:54:30,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68efd9be697b4f2c8825a4b30848c99b for inclusion in 79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:30,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-18 00:54:30,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:30,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:30,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/68efd9be697b4f2c8825a4b30848c99b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bdvd04ac4ubliep0kn2khoe0e8dr0hfub57ei5df5jl8o75tv26glr69bfbm2pss/family1/68efd9be697b4f2c8825a4b30848c99b 2023-11-18 00:54:30,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bdvd04ac4ubliep0kn2khoe0e8dr0hfub57ei5df5jl8o75tv26glr69bfbm2pss/family1/68efd9be697b4f2c8825a4b30848c99b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/772bfcf3e03141739a1b9838e0bb5ea0_SeqId_53_ 2023-11-18 00:54:30,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bdvd04ac4ubliep0kn2khoe0e8dr0hfub57ei5df5jl8o75tv26glr69bfbm2pss/family1/68efd9be697b4f2c8825a4b30848c99b into 79a29bcf437c750e54c6d5f8e605ce5a/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/772bfcf3e03141739a1b9838e0bb5ea0_SeqId_53_ - updating store file list. 2023-11-18 00:54:30,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/772bfcf3e03141739a1b9838e0bb5ea0_SeqId_53_ into 79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:30,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bdvd04ac4ubliep0kn2khoe0e8dr0hfub57ei5df5jl8o75tv26glr69bfbm2pss/family1/68efd9be697b4f2c8825a4b30848c99b into 79a29bcf437c750e54c6d5f8e605ce5a/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/772bfcf3e03141739a1b9838e0bb5ea0_SeqId_53_) 2023-11-18 00:54:30,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bdvd04ac4ubliep0kn2khoe0e8dr0hfub57ei5df5jl8o75tv26glr69bfbm2pss/family1/68efd9be697b4f2c8825a4b30848c99b 2023-11-18 00:54:30,996 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:30,997 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:30,998 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112020283273efed414f806fc92ee095e841 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112020283273efed414f806fc92ee095e841 2023-11-18 00:54:30,999 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112809dc6638e9534ccebef71a7cc6179c2f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112809dc6638e9534ccebef71a7cc6179c2f 2023-11-18 00:54:30,999 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-18 00:54:30,999 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 00:54:31,000 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,000 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,000 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:31,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:31,001 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:31,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 884 msec 2023-11-18 00:54:31,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 00:54:31,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:31,460 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-18 00:54:31,461 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-18 00:54:31,461 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-18 00:54:31,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-18 00:54:31,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, REOPEN/MOVE}] 2023-11-18 00:54:31,467 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, REOPEN/MOVE 2023-11-18 00:54:31,468 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:31,468 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268871468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268871468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268871468"}]},"ts":"1700268871468"} 2023-11-18 00:54:31,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:31,621 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:31,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79a29bcf437c750e54c6d5f8e605ce5a, disabling compactions & flushes 2023-11-18 00:54:31,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:31,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:31,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. after waiting 0 ms 2023-11-18 00:54:31,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:31,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-18 00:54:31,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:31,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:31,628 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 79a29bcf437c750e54c6d5f8e605ce5a to self. 2023-11-18 00:54:31,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=CLOSED 2023-11-18 00:54:31,629 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268871629"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268871629"}]},"ts":"1700268871629"} 2023-11-18 00:54:31,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-18 00:54:31,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711 in 162 msec 2023-11-18 00:54:31,632 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=true 2023-11-18 00:54:31,782 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:31,783 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268871782"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268871782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268871782"}]},"ts":"1700268871782"} 2023-11-18 00:54:31,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:31,935 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:31,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:31,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79a29bcf437c750e54c6d5f8e605ce5a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:54:31,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:31,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,939 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,940 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:31,940 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1 2023-11-18 00:54:31,941 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79a29bcf437c750e54c6d5f8e605ce5a columnFamilyName family1 2023-11-18 00:54:31,945 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/772bfcf3e03141739a1b9838e0bb5ea0_SeqId_53_ 2023-11-18 00:54:31,948 DEBUG [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/family1/9a768c228dff44f6a1b5a7880d4ac6e2 2023-11-18 00:54:31,948 INFO [StoreOpener-79a29bcf437c750e54c6d5f8e605ce5a-1] regionserver.HStore(310): Store=79a29bcf437c750e54c6d5f8e605ce5a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:31,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:54:31,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79a29bcf437c750e54c6d5f8e605ce5a; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63194599, jitterRate=-0.058327093720436096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:54:31,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:54:31,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a., pid=53, masterSystemTime=1700268871935 2023-11-18 00:54:31,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:31,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:54:31,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=79a29bcf437c750e54c6d5f8e605ce5a, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:31,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700268871955"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268871955"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268871955"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268871955"}]},"ts":"1700268871955"} 2023-11-18 00:54:31,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-18 00:54:31,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 79a29bcf437c750e54c6d5f8e605ce5a, server=jenkins-hbase4.apache.org,46287,1700268799711 in 172 msec 2023-11-18 00:54:31,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-18 00:54:31,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=79a29bcf437c750e54c6d5f8e605ce5a, REOPEN/MOVE in 491 msec 2023-11-18 00:54:31,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-18 00:54:31,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 496 msec 2023-11-18 00:54:31,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 910 msec 2023-11-18 00:54:31,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-18 00:54:31,964 INFO [Listener at localhost/41175] compactions.TestMobCompactor(278): alter status finished 2023-11-18 00:54:31,964 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 00:54:31,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:31,966 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:31,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:31,967 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269471967 2023-11-18 00:54:31,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:54:31,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-18 00:54:31,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:31,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x32cb6ad8 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:31,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75304f86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:31,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 00:54:31,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 00:54:31,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:31,974 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 00:54:31,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-11-18 00:54:32,021 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=251 (was 263), OpenFileDescriptor=659 (was 648) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 200), ProcessCount=169 (was 169), AvailableMemoryMB=9283 (was 9291) 2023-11-18 00:54:32,032 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=251, OpenFileDescriptor=659, MaxFileDescriptor=60000, SystemLoadAverage=164, ProcessCount=169, AvailableMemoryMB=9283 2023-11-18 00:54:32,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 00:54:32,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:32,035 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:54:32,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-18 00:54:32,036 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:54:32,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 00:54:32,037 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 2023-11-18 00:54:32,037 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 empty. 2023-11-18 00:54:32,038 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 2023-11-18 00:54:32,038 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-18 00:54:32,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 00:54:32,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 00:54:32,445 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-18 00:54:32,446 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 18747091e256122119350ffc73c8cf88, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:32,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 00:54:32,851 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:32,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 18747091e256122119350ffc73c8cf88, disabling compactions & flushes 2023-11-18 00:54:32,852 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:32,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:32,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. after waiting 0 ms 2023-11-18 00:54:32,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:32,852 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:32,852 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:32,855 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:54:32,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268872856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268872856"}]},"ts":"1700268872856"} 2023-11-18 00:54:32,857 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:54:32,858 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:54:32,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268872858"}]},"ts":"1700268872858"} 2023-11-18 00:54:32,859 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-18 00:54:32,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, ASSIGN}] 2023-11-18 00:54:32,863 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, ASSIGN 2023-11-18 00:54:32,864 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:33,015 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:33,015 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268873015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268873015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268873015"}]},"ts":"1700268873015"} 2023-11-18 00:54:33,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:33,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 00:54:33,167 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:33,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:33,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18747091e256122119350ffc73c8cf88, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:54:33,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:33,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:33,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:33,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:33,171 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:33,173 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:33,173 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:33,173 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18747091e256122119350ffc73c8cf88 columnFamilyName family1 2023-11-18 00:54:33,174 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(310): Store=18747091e256122119350ffc73c8cf88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:33,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 2023-11-18 00:54:33,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 2023-11-18 00:54:33,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:33,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:33,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18747091e256122119350ffc73c8cf88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70751513, jitterRate=0.05427969992160797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:54:33,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:33,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88., pid=57, masterSystemTime=1700268873167 2023-11-18 00:54:33,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:33,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:33,182 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:33,182 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268873182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268873182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268873182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268873182"}]},"ts":"1700268873182"} 2023-11-18 00:54:33,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-18 00:54:33,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711 in 167 msec 2023-11-18 00:54:33,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-18 00:54:33,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, ASSIGN in 323 msec 2023-11-18 00:54:33,186 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:54:33,186 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268873186"}]},"ts":"1700268873186"} 2023-11-18 00:54:33,187 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-18 00:54:33,190 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:54:33,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1570 sec 2023-11-18 00:54:33,590 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:34,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 00:54:34,140 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-18 00:54:34,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:34,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,166 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:34,166 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:34,166 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:34,166 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:34,167 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,167 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,169 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:34,169 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:34,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:34,170 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,170 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:34,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:34,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,171 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:34,171 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:34,171 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:34,171 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:34,172 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 00:54:34,192 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113066231aa8dae545c0a515e0cd7a988c6c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113066231aa8dae545c0a515e0cd7a988c6c 2023-11-18 00:54:34,195 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/7ee04c17d54d4654bc19b37fd36fc636 2023-11-18 00:54:34,200 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/7ee04c17d54d4654bc19b37fd36fc636 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/7ee04c17d54d4654bc19b37fd36fc636 2023-11-18 00:54:34,204 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/7ee04c17d54d4654bc19b37fd36fc636, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-18 00:54:34,205 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 33ms, sequenceid=5, compaction requested=false 2023-11-18 00:54:34,206 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:34,206 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:34,206 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:34,206 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:34,206 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,206 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:34,206 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:34,208 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,208 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:34,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:34,208 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,208 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:34,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:34,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:34,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:34,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:34,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cd08267[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:34,210 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:34,210 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,212 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,212 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:34,212 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:34,212 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,212 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:34,212 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:34,214 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,214 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:34,214 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:34,214 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:34,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:34,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:34,217 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:34,218 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:34,218 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:34,218 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,218 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:34,227 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,227 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:34,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,227 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,227 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:34,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,228 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:34,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:34,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:34,231 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:34,231 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:34,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-18 00:54:34,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:34,331 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:34,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:34,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:34,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:34,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,338 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:34,338 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:34,338 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:34,338 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:34,338 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,338 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,340 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:34,340 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:34,340 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:34,340 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,341 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:34,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:34,341 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:34,341 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:34,341 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:34,342 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:34,342 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:34,342 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:34,342 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:34,342 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 00:54:34,754 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112805484dad35894107807abb12e80cea40 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112805484dad35894107807abb12e80cea40 2023-11-18 00:54:35,160 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/f60d0af5c6ce47fd86705cb4ad3dc35e 2023-11-18 00:54:35,165 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/f60d0af5c6ce47fd86705cb4ad3dc35e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/f60d0af5c6ce47fd86705cb4ad3dc35e 2023-11-18 00:54:35,169 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/f60d0af5c6ce47fd86705cb4ad3dc35e, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 00:54:35,169 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 827ms, sequenceid=9, compaction requested=false 2023-11-18 00:54:35,170 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:35,170 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:35,170 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:35,172 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:35,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:35,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:35,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10eba17b[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:35,173 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:35,173 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,174 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,175 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:35,175 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:35,175 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:35,175 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,175 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:35,176 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:35,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:35,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:35,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:35,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:35,179 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:35,179 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:35,179 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:35,179 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,179 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:35,186 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,186 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,186 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:35,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:35,187 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,188 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,190 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,190 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,190 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:35,190 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,190 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:35,190 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:35,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:35,190 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:35,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:35,191 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:35,191 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,191 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,191 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:35,191 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:35,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:35,291 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:35,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:35,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:35,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:35,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,297 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:35,297 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:35,297 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:35,297 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:35,297 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,297 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,298 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,299 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:35,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:35,299 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:35,299 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:35,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:35,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,300 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,300 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:35,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:35,300 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:35,300 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:35,300 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:35,301 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:35,301 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:35,301 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:35,301 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:35,301 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:35,315 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:54:35,714 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019216316945b14bf2b2fe34ad994f0a36 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512019216316945b14bf2b2fe34ad994f0a36 2023-11-18 00:54:36,119 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/9000d18138b24a4b9942bbc8348f9133 2023-11-18 00:54:36,124 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/9000d18138b24a4b9942bbc8348f9133 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9000d18138b24a4b9942bbc8348f9133 2023-11-18 00:54:36,128 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9000d18138b24a4b9942bbc8348f9133, entries=1, sequenceid=13, filesize=5.0 K 2023-11-18 00:54:36,129 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 828ms, sequenceid=13, compaction requested=true 2023-11-18 00:54:36,129 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:36,129 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:36,129 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:36,129 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:36,129 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,129 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:36,129 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:36,131 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,131 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:36,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:36,131 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,132 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:36,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:36,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:36,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:36,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:36,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5712ead1[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:36,133 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:36,133 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,135 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,135 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:36,135 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:36,135 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:36,135 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,136 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:36,137 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,137 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:36,137 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:36,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:36,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:36,137 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:36,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:36,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:36,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:36,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:36,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:36,139 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:36,139 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:36,139 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:36,139 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,139 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:36,141 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,141 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:36,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:36,141 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:36,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:36,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:36,142 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:36,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,143 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:36,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:36,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:36,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:36,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:36,149 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:36,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,149 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:36,150 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,250 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:36,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:36,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:36,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:36,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,255 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:36,255 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:36,255 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:36,255 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:36,256 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,256 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,265 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:36,265 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:36,265 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:36,265 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,266 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:36,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:36,267 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:36,267 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:36,267 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:36,683 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ceaa02848c1f43368d6b2a1af4354734 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ceaa02848c1f43368d6b2a1af4354734 2023-11-18 00:54:37,089 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/9f8adcaa0bbc427a9c5520b2ef4bf062 2023-11-18 00:54:37,093 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/9f8adcaa0bbc427a9c5520b2ef4bf062 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9f8adcaa0bbc427a9c5520b2ef4bf062 2023-11-18 00:54:37,097 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9f8adcaa0bbc427a9c5520b2ef4bf062, entries=1, sequenceid=17, filesize=5.0 K 2023-11-18 00:54:37,098 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 831ms, sequenceid=17, compaction requested=true 2023-11-18 00:54:37,098 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:37,098 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:37,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:37,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:37,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:37,099 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:37,100 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,100 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:37,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:37,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:37,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:37,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59296eba[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:37,102 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:37,102 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,103 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,103 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:37,103 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:37,103 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:37,103 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,103 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:37,106 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:37,106 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:37,106 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,106 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:37,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:37,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:37,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:37,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:37,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:37,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:37,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:37,109 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:37,109 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:37,109 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:37,109 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,109 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:37,110 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,110 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:37,110 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:37,111 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:37,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,112 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:37,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:37,115 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:37,115 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:37,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:37,215 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:37,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:37,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:37,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:37,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,222 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:37,222 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:37,222 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:37,222 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:37,222 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,222 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,223 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,223 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:37,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:37,224 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:37,224 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,225 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,225 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:37,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:37,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:37,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:37,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:37,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:37,225 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:37,225 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:37,225 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:37,225 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:37,637 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a1f5b52ac2564dbbbd68011d036c6ca3 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228a1f5b52ac2564dbbbd68011d036c6ca3 2023-11-18 00:54:38,043 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/6b9b71d05283417e9156057a5f95d5eb 2023-11-18 00:54:38,047 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/6b9b71d05283417e9156057a5f95d5eb as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/6b9b71d05283417e9156057a5f95d5eb 2023-11-18 00:54:38,051 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/6b9b71d05283417e9156057a5f95d5eb, entries=1, sequenceid=21, filesize=5.0 K 2023-11-18 00:54:38,052 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 827ms, sequenceid=21, compaction requested=true 2023-11-18 00:54:38,052 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:38,052 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:38,052 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:38,055 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,055 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:38,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:38,055 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,055 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:38,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:38,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:38,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71c21c42[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:38,057 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:38,057 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,058 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:38,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:38,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:38,059 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,059 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:38,060 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:38,060 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:38,060 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,060 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:38,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:38,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:38,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:38,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:38,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:38,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:38,063 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:38,063 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:38,063 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:38,063 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,063 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:38,065 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,065 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:38,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,065 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:38,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:38,066 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,068 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:38,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:38,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,071 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:38,071 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:38,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,172 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:38,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:38,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:38,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:38,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,177 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:38,178 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:38,178 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:38,178 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:38,178 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,178 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,179 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:38,179 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:38,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:38,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:38,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:38,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:38,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,180 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,181 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:38,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:38,181 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:38,181 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:38,181 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:38,181 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:38,181 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:38,181 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:38,181 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:38,181 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:38,594 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311947c2bb70464448908299dad282a588 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311947c2bb70464448908299dad282a588 2023-11-18 00:54:38,999 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/0253ee33f313406ca9017eff157e2c4a 2023-11-18 00:54:39,004 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/0253ee33f313406ca9017eff157e2c4a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/0253ee33f313406ca9017eff157e2c4a 2023-11-18 00:54:39,007 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/0253ee33f313406ca9017eff157e2c4a, entries=1, sequenceid=25, filesize=5.0 K 2023-11-18 00:54:39,008 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 827ms, sequenceid=25, compaction requested=true 2023-11-18 00:54:39,008 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:39,008 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:39,011 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:39,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:39,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:39,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c6f8b78[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:39,012 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:39,013 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,017 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:39,017 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,017 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:39,018 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:39,018 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:39,018 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,018 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:39,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:39,021 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:39,021 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:39,021 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:39,021 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,021 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:39,023 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,023 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:39,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,023 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:39,023 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,024 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:39,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:39,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:39,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-18 00:54:39,027 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,027 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,127 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:39,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:39,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:39,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:39,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,133 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:39,133 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:39,134 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:39,134 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:39,134 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,134 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,138 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:39,138 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:39,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:39,139 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,139 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,139 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,139 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:39,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:39,140 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:39,140 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:39,140 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:39,140 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:39,552 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012ea880eecf2846e8a422650fcefd95dc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601012ea880eecf2846e8a422650fcefd95dc 2023-11-18 00:54:39,957 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/86babb3bd68248e2b901d6f7cdb0eb88 2023-11-18 00:54:39,961 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/86babb3bd68248e2b901d6f7cdb0eb88 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/86babb3bd68248e2b901d6f7cdb0eb88 2023-11-18 00:54:39,965 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/86babb3bd68248e2b901d6f7cdb0eb88, entries=1, sequenceid=29, filesize=5.0 K 2023-11-18 00:54:39,966 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 826ms, sequenceid=29, compaction requested=true 2023-11-18 00:54:39,966 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:39,966 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:39,968 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,968 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:39,968 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,968 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:39,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:39,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cebaa46[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:39,969 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:39,969 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,970 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,971 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:39,971 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,971 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:39,971 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:39,971 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:39,973 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:39,973 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,973 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:39,973 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:39,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:39,975 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:39,975 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:39,975 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:39,975 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,975 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:39,977 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,977 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:39,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,977 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:39,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:39,978 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,979 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,981 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:39,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:39,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:39,982 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:39,982 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:39,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:40,082 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:40,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:40,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:40,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:40,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,089 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:40,089 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:40,089 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:40,089 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:40,089 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,089 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,091 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,091 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:40,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:40,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:40,091 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,091 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:40,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:40,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,092 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:40,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,092 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:40,092 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:40,092 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:40,093 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:40,093 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:40,093 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:40,093 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:40,093 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:40,107 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103bdad83f43e324276973018d75e5aaced to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103bdad83f43e324276973018d75e5aaced 2023-11-18 00:54:40,512 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/3a823e47ace24570bfbfd63944568042 2023-11-18 00:54:40,518 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/3a823e47ace24570bfbfd63944568042 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/3a823e47ace24570bfbfd63944568042 2023-11-18 00:54:40,523 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/3a823e47ace24570bfbfd63944568042, entries=1, sequenceid=33, filesize=5.0 K 2023-11-18 00:54:40,523 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 430ms, sequenceid=33, compaction requested=true 2023-11-18 00:54:40,524 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:40,524 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:40,524 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:40,524 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:40,524 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,524 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:40,524 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:40,526 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,526 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:40,526 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,526 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:40,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:40,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ea557df[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:40,528 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:40,528 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,529 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,530 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:40,530 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:40,530 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:40,530 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,530 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:40,534 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,534 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:40,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:40,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:40,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:40,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:40,536 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:40,536 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:40,536 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:40,536 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,536 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:40,538 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,538 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,538 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:40,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:40,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:40,539 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,540 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:40,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:40,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-18 00:54:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:40,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:40,544 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:40,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,545 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:40,545 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:40,645 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:40,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:40,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:40,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:40,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,651 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:40,651 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:40,651 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:40,651 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:40,652 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,652 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,654 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:40,654 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:40,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:40,655 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,655 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:40,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:40,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,656 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:40,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:40,657 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:40,657 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:40,657 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:40,657 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:40,671 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a125855f96604da0b31dfcfc2e914cab to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907a125855f96604da0b31dfcfc2e914cab 2023-11-18 00:54:40,677 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/4820fd4da01e4b5cabd46bf3940a81bc 2023-11-18 00:54:40,681 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/4820fd4da01e4b5cabd46bf3940a81bc as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/4820fd4da01e4b5cabd46bf3940a81bc 2023-11-18 00:54:40,685 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/4820fd4da01e4b5cabd46bf3940a81bc, entries=1, sequenceid=37, filesize=5.0 K 2023-11-18 00:54:40,685 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 28ms, sequenceid=37, compaction requested=true 2023-11-18 00:54:40,686 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:40,686 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:40,687 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,687 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:40,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:40,688 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,688 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:40,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:40,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fe46645[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:40,689 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:40,690 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:40,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:40,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:40,691 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,691 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:40,692 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,692 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:40,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:40,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:40,692 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:40,693 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:40,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:40,695 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:40,695 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:40,695 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:40,695 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,695 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:40,697 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,697 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:40,697 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:40,698 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,699 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:40,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,701 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:40,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:40,702 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:40,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,702 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:40,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:40,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:40,802 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:40,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:40,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:40,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:40,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,808 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:40,808 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:40,808 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 00:54:40,808 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 00:54:40,808 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,808 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,809 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,809 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:40,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:40,810 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:40,810 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:40,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,811 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,811 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 00:54:40,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 00:54:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 00:54:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:54:40,811 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:40,811 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:40,811 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. started... 2023-11-18 00:54:40,811 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 18747091e256122119350ffc73c8cf88 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:54:41,224 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120dc71c66c20cc48299c0a97cfb048daa8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120dc71c66c20cc48299c0a97cfb048daa8 2023-11-18 00:54:41,629 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/ff5e42b3d3f64d8d9881b1e644ddc1c1 2023-11-18 00:54:41,633 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/ff5e42b3d3f64d8d9881b1e644ddc1c1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/ff5e42b3d3f64d8d9881b1e644ddc1c1 2023-11-18 00:54:41,637 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/ff5e42b3d3f64d8d9881b1e644ddc1c1, entries=1, sequenceid=41, filesize=5.0 K 2023-11-18 00:54:41,638 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 18747091e256122119350ffc73c8cf88 in 827ms, sequenceid=41, compaction requested=true 2023-11-18 00:54:41,638 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:41,638 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:41,638 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:54:41,638 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:54:41,638 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,638 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 00:54:41,638 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 00:54:41,640 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,640 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:41,640 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,640 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:41,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:41,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 00:54:41,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f90088a[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:41,642 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 00:54:41,642 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,644 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 00:54:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 00:54:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:41,644 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,644 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 00:54:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:41,645 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 00:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:41,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:41,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 00:54:41,648 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 00:54:41,648 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:41,648 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:41,648 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,648 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:41,649 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,649 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:41,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,649 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:41,650 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:41,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,651 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,656 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:41,656 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:41,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 00:54:41,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:41,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-18 00:54:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:41,656 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:41,656 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,656 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:41,657 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:41,657 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:41,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:41,657 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:41,657 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:41,657 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,657 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,657 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,757 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:41,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:41,759 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:41,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:41,761 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:41,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:41,762 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269481762 2023-11-18 00:54:41,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:54:41,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-18 00:54:41,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:41,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x2ecb18a5 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:41,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f5f46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:41,769 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,124 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32cb6ad8 to 127.0.0.1:58527 2023-11-18 00:54:42,124 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:42,124 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:42,125 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64ea5d4a to 127.0.0.1:58527 2023-11-18 00:54:42,125 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:42,125 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:42,125 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07e297b1 to 127.0.0.1:58527 2023-11-18 00:54:42,125 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:42,126 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:42,126 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23bd709c to 127.0.0.1:58527 2023-11-18 00:54:42,126 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:42,126 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:42,126 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x082f052a to 127.0.0.1:58527 2023-11-18 00:54:42,126 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:42,211 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ac32d22492004bf3b17b7ef17abbc067 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ac32d22492004bf3b17b7ef17abbc067 2023-11-18 00:54:42,212 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:42,225 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:54:42,226 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:54:42,233 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:54:42,234 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:54:42,242 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c27048f5de2345329e8787eda51e8df7 first=Optional[r3] last=Optional[r6] 2023-11-18 00:54:42,242 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c27048f5de2345329e8787eda51e8df7}] 2023-11-18 00:54:42,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c27048f5de2345329e8787eda51e8df7 for inclusion in 18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:42,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 00:54:42,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:42,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:42,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c27048f5de2345329e8787eda51e8df7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tnk0vk6kf5sr6unp8qiefj789djkc3jtinrgfp52pde9l1pqdbihhpl8t70rg5db/family1/c27048f5de2345329e8787eda51e8df7 2023-11-18 00:54:42,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tnk0vk6kf5sr6unp8qiefj789djkc3jtinrgfp52pde9l1pqdbihhpl8t70rg5db/family1/c27048f5de2345329e8787eda51e8df7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_ 2023-11-18 00:54:42,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tnk0vk6kf5sr6unp8qiefj789djkc3jtinrgfp52pde9l1pqdbihhpl8t70rg5db/family1/c27048f5de2345329e8787eda51e8df7 into 18747091e256122119350ffc73c8cf88/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_ - updating store file list. 2023-11-18 00:54:42,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_ into 18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:42,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tnk0vk6kf5sr6unp8qiefj789djkc3jtinrgfp52pde9l1pqdbihhpl8t70rg5db/family1/c27048f5de2345329e8787eda51e8df7 into 18747091e256122119350ffc73c8cf88/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_) 2023-11-18 00:54:42,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tnk0vk6kf5sr6unp8qiefj789djkc3jtinrgfp52pde9l1pqdbihhpl8t70rg5db/family1/c27048f5de2345329e8787eda51e8df7 2023-11-18 00:54:42,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 00:54:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 00:54:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 18747091e256122119350ffc73c8cf88/family1 is initiating minor compaction 2023-11-18 00:54:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2b0de1ed; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:42,259 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 18747091e256122119350ffc73c8cf88/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:42,259 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/f60d0af5c6ce47fd86705cb4ad3dc35e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9000d18138b24a4b9942bbc8348f9133, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9f8adcaa0bbc427a9c5520b2ef4bf062, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/6b9b71d05283417e9156057a5f95d5eb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/0253ee33f313406ca9017eff157e2c4a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/86babb3bd68248e2b901d6f7cdb0eb88, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/3a823e47ace24570bfbfd63944568042, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/4820fd4da01e4b5cabd46bf3940a81bc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/ff5e42b3d3f64d8d9881b1e644ddc1c1, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp, totalSize=50.3 K 2023-11-18 00:54:42,259 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting f60d0af5c6ce47fd86705cb4ad3dc35e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 00:54:42,259 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 9000d18138b24a4b9942bbc8348f9133, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 00:54:42,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 9f8adcaa0bbc427a9c5520b2ef4bf062, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 00:54:42,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 6b9b71d05283417e9156057a5f95d5eb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 00:54:42,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 0253ee33f313406ca9017eff157e2c4a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 00:54:42,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 86babb3bd68248e2b901d6f7cdb0eb88, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 00:54:42,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 3a823e47ace24570bfbfd63944568042, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 00:54:42,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 4820fd4da01e4b5cabd46bf3940a81bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 00:54:42,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting ff5e42b3d3f64d8d9881b1e644ddc1c1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 00:54:42,260 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 00:54:42,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:42,262 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:42,263 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228a1f5b52ac2564dbbbd68011d036c6ca3 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228a1f5b52ac2564dbbbd68011d036c6ca3 2023-11-18 00:54:42,265 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311947c2bb70464448908299dad282a588 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311947c2bb70464448908299dad282a588 2023-11-18 00:54:42,266 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601012ea880eecf2846e8a422650fcefd95dc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601012ea880eecf2846e8a422650fcefd95dc 2023-11-18 00:54:42,267 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103bdad83f43e324276973018d75e5aaced to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103bdad83f43e324276973018d75e5aaced 2023-11-18 00:54:42,267 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-18 00:54:42,267 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 00:54:42,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:42,294 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 18747091e256122119350ffc73c8cf88#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:43,109 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/8242c35123ec4d8eb6db3bcaec5a25c5 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/8242c35123ec4d8eb6db3bcaec5a25c5 2023-11-18 00:54:43,114 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 18747091e256122119350ffc73c8cf88/family1 of 18747091e256122119350ffc73c8cf88 into 8242c35123ec4d8eb6db3bcaec5a25c5(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:54:43,114 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205067b568222c543afbd51c9b96626b264 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205067b568222c543afbd51c9b96626b264 2023-11-18 00:54:43,114 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:43,114 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700268882259; duration=0sec 2023-11-18 00:54:43,115 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:43,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:43,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/f60d0af5c6ce47fd86705cb4ad3dc35e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9000d18138b24a4b9942bbc8348f9133, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9f8adcaa0bbc427a9c5520b2ef4bf062, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/6b9b71d05283417e9156057a5f95d5eb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/0253ee33f313406ca9017eff157e2c4a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/86babb3bd68248e2b901d6f7cdb0eb88, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/3a823e47ace24570bfbfd63944568042, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/4820fd4da01e4b5cabd46bf3940a81bc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/ff5e42b3d3f64d8d9881b1e644ddc1c1, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_] to archive 2023-11-18 00:54:43,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:43,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/f60d0af5c6ce47fd86705cb4ad3dc35e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/f60d0af5c6ce47fd86705cb4ad3dc35e 2023-11-18 00:54:43,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9000d18138b24a4b9942bbc8348f9133 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9000d18138b24a4b9942bbc8348f9133 2023-11-18 00:54:43,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9f8adcaa0bbc427a9c5520b2ef4bf062 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/9f8adcaa0bbc427a9c5520b2ef4bf062 2023-11-18 00:54:43,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/6b9b71d05283417e9156057a5f95d5eb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/6b9b71d05283417e9156057a5f95d5eb 2023-11-18 00:54:43,146 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/994bf86425374ff4b6cede31e779975e first=Optional[r00] last=Optional[r2] 2023-11-18 00:54:43,147 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/994bf86425374ff4b6cede31e779975e}] 2023-11-18 00:54:43,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/0253ee33f313406ca9017eff157e2c4a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/0253ee33f313406ca9017eff157e2c4a 2023-11-18 00:54:43,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/86babb3bd68248e2b901d6f7cdb0eb88 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/86babb3bd68248e2b901d6f7cdb0eb88 2023-11-18 00:54:43,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/994bf86425374ff4b6cede31e779975e for inclusion in 18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:43,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/3a823e47ace24570bfbfd63944568042 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/3a823e47ace24570bfbfd63944568042 2023-11-18 00:54:43,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/4820fd4da01e4b5cabd46bf3940a81bc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/4820fd4da01e4b5cabd46bf3940a81bc 2023-11-18 00:54:43,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-18 00:54:43,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:43,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:43,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/ff5e42b3d3f64d8d9881b1e644ddc1c1 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/ff5e42b3d3f64d8d9881b1e644ddc1c1 2023-11-18 00:54:43,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/994bf86425374ff4b6cede31e779975e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1dhrt3g5d6a04ni2a9lde81ac3gijh2f39uboviru92p8dpufhq74dqkebrk01va/family1/994bf86425374ff4b6cede31e779975e 2023-11-18 00:54:43,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b8fbcf108014459180bd3c7e9ab7bf8f_SeqId_44_ 2023-11-18 00:54:43,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1dhrt3g5d6a04ni2a9lde81ac3gijh2f39uboviru92p8dpufhq74dqkebrk01va/family1/994bf86425374ff4b6cede31e779975e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_ 2023-11-18 00:54:43,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1dhrt3g5d6a04ni2a9lde81ac3gijh2f39uboviru92p8dpufhq74dqkebrk01va/family1/994bf86425374ff4b6cede31e779975e into 18747091e256122119350ffc73c8cf88/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_ - updating store file list. 2023-11-18 00:54:43,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_ into 18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:43,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1dhrt3g5d6a04ni2a9lde81ac3gijh2f39uboviru92p8dpufhq74dqkebrk01va/family1/994bf86425374ff4b6cede31e779975e into 18747091e256122119350ffc73c8cf88/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_) 2023-11-18 00:54:43,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1dhrt3g5d6a04ni2a9lde81ac3gijh2f39uboviru92p8dpufhq74dqkebrk01va/family1/994bf86425374ff4b6cede31e779975e 2023-11-18 00:54:43,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 00:54:43,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 00:54:43,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 18747091e256122119350ffc73c8cf88/family1 is initiating minor compaction (all files) 2023-11-18 00:54:43,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@91cf2ef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:43,163 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 18747091e256122119350ffc73c8cf88/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:43,163 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/7ee04c17d54d4654bc19b37fd36fc636, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/8242c35123ec4d8eb6db3bcaec5a25c5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp, totalSize=388.1 K 2023-11-18 00:54:43,164 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 7ee04c17d54d4654bc19b37fd36fc636, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823326 2023-11-18 00:54:43,164 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 8242c35123ec4d8eb6db3bcaec5a25c5, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223326 2023-11-18 00:54:43,165 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823326 2023-11-18 00:54:43,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:43,165 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:43,167 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113066231aa8dae545c0a515e0cd7a988c6c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113066231aa8dae545c0a515e0cd7a988c6c 2023-11-18 00:54:43,168 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512019216316945b14bf2b2fe34ad994f0a36 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512019216316945b14bf2b2fe34ad994f0a36 2023-11-18 00:54:43,169 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ceaa02848c1f43368d6b2a1af4354734 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ceaa02848c1f43368d6b2a1af4354734 2023-11-18 00:54:43,169 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-18 00:54:43,169 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 00:54:43,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:43,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:43,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:43,171 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:43,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4110 sec 2023-11-18 00:54:43,182 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 18747091e256122119350ffc73c8cf88#family1#compaction#74 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:43,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 00:54:43,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:43,656 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-18 00:54:43,657 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-18 00:54:43,657 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-18 00:54:43,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-18 00:54:43,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, REOPEN/MOVE}] 2023-11-18 00:54:43,661 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, REOPEN/MOVE 2023-11-18 00:54:43,662 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:43,662 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268883662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268883662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268883662"}]},"ts":"1700268883662"} 2023-11-18 00:54:43,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:43,814 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:43,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:43,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18747091e256122119350ffc73c8cf88, disabling compactions & flushes 2023-11-18 00:54:43,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:44,399 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/.tmp/family1/b2dbafe885bc45eda26f1b4a7ae622a0 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b2dbafe885bc45eda26f1b4a7ae622a0 2023-11-18 00:54:44,404 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 18747091e256122119350ffc73c8cf88/family1 of 18747091e256122119350ffc73c8cf88 into b2dbafe885bc45eda26f1b4a7ae622a0(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:54:44,404 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:44,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:44,404 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1700268883163; duration=1sec 2023-11-18 00:54:44,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:44,404 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:44,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. after waiting 0 ms 2023-11-18 00:54:44,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:44,407 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/7ee04c17d54d4654bc19b37fd36fc636, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/8242c35123ec4d8eb6db3bcaec5a25c5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_] to archive 2023-11-18 00:54:44,407 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:44,409 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/7ee04c17d54d4654bc19b37fd36fc636 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/7ee04c17d54d4654bc19b37fd36fc636 2023-11-18 00:54:44,410 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/8242c35123ec4d8eb6db3bcaec5a25c5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/8242c35123ec4d8eb6db3bcaec5a25c5 2023-11-18 00:54:44,411 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/68808d9ba9e0448fb6684de67c30d0d2_SeqId_47_ 2023-11-18 00:54:44,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 00:54:44,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:44,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:44,417 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 18747091e256122119350ffc73c8cf88 to self. 2023-11-18 00:54:44,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:44,418 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=CLOSED 2023-11-18 00:54:44,418 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268884418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268884418"}]},"ts":"1700268884418"} 2023-11-18 00:54:44,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-18 00:54:44,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711 in 756 msec 2023-11-18 00:54:44,421 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=true 2023-11-18 00:54:44,571 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:44,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268884571"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268884571"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268884571"}]},"ts":"1700268884571"} 2023-11-18 00:54:44,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:44,724 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:44,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:44,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18747091e256122119350ffc73c8cf88, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:54:44,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:44,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:44,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:44,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:44,728 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:44,729 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:44,729 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:44,729 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18747091e256122119350ffc73c8cf88 columnFamilyName family1 2023-11-18 00:54:44,734 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b2dbafe885bc45eda26f1b4a7ae622a0 2023-11-18 00:54:44,734 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(310): Store=18747091e256122119350ffc73c8cf88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:44,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 2023-11-18 00:54:44,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 2023-11-18 00:54:44,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:44,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18747091e256122119350ffc73c8cf88; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66805173, jitterRate=-0.004525348544120789}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:54:44,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:44,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88., pid=63, masterSystemTime=1700268884724 2023-11-18 00:54:44,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:44,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:44,740 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:44,741 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268884740"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268884740"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268884740"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268884740"}]},"ts":"1700268884740"} 2023-11-18 00:54:44,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-18 00:54:44,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711 in 169 msec 2023-11-18 00:54:44,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-18 00:54:44,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, REOPEN/MOVE in 1.0820 sec 2023-11-18 00:54:44,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-18 00:54:44,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0860 sec 2023-11-18 00:54:44,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5000 sec 2023-11-18 00:54:44,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-18 00:54:44,749 INFO [Listener at localhost/41175] compactions.TestMobCompactor(278): alter status finished 2023-11-18 00:54:44,750 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:44,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:44,751 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:44,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:44,752 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269484752 2023-11-18 00:54:44,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:54:44,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-18 00:54:44,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:44,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x3ec03414 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:44,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e444248, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:44,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:44,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:44,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:44,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:44,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:45,582 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c8bf841015c64c96a6f56e7d46457f41 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128c8bf841015c64c96a6f56e7d46457f41 2023-11-18 00:54:45,582 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:45,595 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:54:45,596 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:54:45,601 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:54:45,603 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:54:45,610 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0ca0c5e64c3c4d67bc321de5a889715f first=Optional[r05] last=Optional[r8] 2023-11-18 00:54:45,611 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=51 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0ca0c5e64c3c4d67bc321de5a889715f}] 2023-11-18 00:54:45,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0ca0c5e64c3c4d67bc321de5a889715f for inclusion in 18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:45,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-18 00:54:45,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:45,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:45,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0ca0c5e64c3c4d67bc321de5a889715f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p66lfvd8stmsd700du7d6ddg4iti4con1p6etbejp0f41i4amblm9819k90394t5/family1/0ca0c5e64c3c4d67bc321de5a889715f 2023-11-18 00:54:45,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p66lfvd8stmsd700du7d6ddg4iti4con1p6etbejp0f41i4amblm9819k90394t5/family1/0ca0c5e64c3c4d67bc321de5a889715f as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/94f5cc2c58694b68836cf7f406c1c312_SeqId_53_ 2023-11-18 00:54:45,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p66lfvd8stmsd700du7d6ddg4iti4con1p6etbejp0f41i4amblm9819k90394t5/family1/0ca0c5e64c3c4d67bc321de5a889715f into 18747091e256122119350ffc73c8cf88/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/94f5cc2c58694b68836cf7f406c1c312_SeqId_53_ - updating store file list. 2023-11-18 00:54:45,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/94f5cc2c58694b68836cf7f406c1c312_SeqId_53_ into 18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:45,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p66lfvd8stmsd700du7d6ddg4iti4con1p6etbejp0f41i4amblm9819k90394t5/family1/0ca0c5e64c3c4d67bc321de5a889715f into 18747091e256122119350ffc73c8cf88/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/94f5cc2c58694b68836cf7f406c1c312_SeqId_53_) 2023-11-18 00:54:45,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__p66lfvd8stmsd700du7d6ddg4iti4con1p6etbejp0f41i4amblm9819k90394t5/family1/0ca0c5e64c3c4d67bc321de5a889715f 2023-11-18 00:54:45,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:45,626 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:45,627 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120dc71c66c20cc48299c0a97cfb048daa8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120dc71c66c20cc48299c0a97cfb048daa8 2023-11-18 00:54:45,628 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112805484dad35894107807abb12e80cea40 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112805484dad35894107807abb12e80cea40 2023-11-18 00:54:45,628 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-18 00:54:45,628 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 00:54:45,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:45,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:45,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:45,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:45,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:45,630 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:45,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 880 msec 2023-11-18 00:54:45,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-18 00:54:45,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:46,089 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-18 00:54:46,090 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-18 00:54:46,090 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-18 00:54:46,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-18 00:54:46,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, REOPEN/MOVE}] 2023-11-18 00:54:46,095 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, REOPEN/MOVE 2023-11-18 00:54:46,095 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:46,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268886095"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268886095"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268886095"}]},"ts":"1700268886095"} 2023-11-18 00:54:46,095 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38477] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=CLOSING, location=jenkins-hbase4.apache.org,46287,1700268799711, table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-11-18 00:54:46,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:46,248 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:46,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18747091e256122119350ffc73c8cf88, disabling compactions & flushes 2023-11-18 00:54:46,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:46,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:46,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. after waiting 0 ms 2023-11-18 00:54:46,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:46,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-18 00:54:46,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:46,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:46,256 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 18747091e256122119350ffc73c8cf88 to self. 2023-11-18 00:54:46,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=CLOSED 2023-11-18 00:54:46,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268886257"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268886257"}]},"ts":"1700268886257"} 2023-11-18 00:54:46,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-18 00:54:46,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711 in 163 msec 2023-11-18 00:54:46,260 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=true 2023-11-18 00:54:46,411 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:46,411 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268886411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268886411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268886411"}]},"ts":"1700268886411"} 2023-11-18 00:54:46,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:46,564 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:46,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:46,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18747091e256122119350ffc73c8cf88, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:54:46,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:46,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,567 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,568 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:46,568 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1 2023-11-18 00:54:46,569 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18747091e256122119350ffc73c8cf88 columnFamilyName family1 2023-11-18 00:54:46,574 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/94f5cc2c58694b68836cf7f406c1c312_SeqId_53_ 2023-11-18 00:54:46,577 DEBUG [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/family1/b2dbafe885bc45eda26f1b4a7ae622a0 2023-11-18 00:54:46,577 INFO [StoreOpener-18747091e256122119350ffc73c8cf88-1] regionserver.HStore(310): Store=18747091e256122119350ffc73c8cf88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:46,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18747091e256122119350ffc73c8cf88 2023-11-18 00:54:46,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18747091e256122119350ffc73c8cf88; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72746708, jitterRate=0.08401042222976685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:54:46,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:54:46,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88., pid=69, masterSystemTime=1700268886563 2023-11-18 00:54:46,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:46,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:54:46,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=18747091e256122119350ffc73c8cf88, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:46,585 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700268886585"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268886585"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268886585"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268886585"}]},"ts":"1700268886585"} 2023-11-18 00:54:46,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-18 00:54:46,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 18747091e256122119350ffc73c8cf88, server=jenkins-hbase4.apache.org,46287,1700268799711 in 174 msec 2023-11-18 00:54:46,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-18 00:54:46,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=18747091e256122119350ffc73c8cf88, REOPEN/MOVE in 493 msec 2023-11-18 00:54:46,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-18 00:54:46,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 497 msec 2023-11-18 00:54:46,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 910 msec 2023-11-18 00:54:46,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-18 00:54:46,593 INFO [Listener at localhost/41175] compactions.TestMobCompactor(278): alter status finished 2023-11-18 00:54:46,594 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 00:54:46,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:46,595 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:46,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:46,596 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269486596 2023-11-18 00:54:46,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:54:46,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-18 00:54:46,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:46,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x28bd1eb6 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:46,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cc94bb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:46,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:46,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:46,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:46,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:46,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:46,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:46,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:46,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 00:54:46,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 00:54:46,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:46,604 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 00:54:46,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-11-18 00:54:46,649 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244 (was 251), OpenFileDescriptor=648 (was 659), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=128 (was 164), ProcessCount=167 (was 169), AvailableMemoryMB=9243 (was 9283) 2023-11-18 00:54:46,659 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=243, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=128, ProcessCount=167, AvailableMemoryMB=9242 2023-11-18 00:54:46,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 00:54:46,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-18 00:54:46,663 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:54:46,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-18 00:54:46,664 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:54:46,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 00:54:46,665 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:46,666 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527 empty. 2023-11-18 00:54:46,666 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:46,666 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-18 00:54:46,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 00:54:46,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 00:54:47,073 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-18 00:54:47,075 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0035d1a377392eee8a165c72885c9527, NAME => 'testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:47,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 00:54:47,480 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:47,480 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 0035d1a377392eee8a165c72885c9527, disabling compactions & flushes 2023-11-18 00:54:47,480 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:47,480 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:47,480 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. after waiting 0 ms 2023-11-18 00:54:47,480 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:47,480 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:47,480 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 0035d1a377392eee8a165c72885c9527: 2023-11-18 00:54:47,482 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:54:47,483 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700268887483"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268887483"}]},"ts":"1700268887483"} 2023-11-18 00:54:47,484 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:54:47,485 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:54:47,485 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268887485"}]},"ts":"1700268887485"} 2023-11-18 00:54:47,486 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-18 00:54:47,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0035d1a377392eee8a165c72885c9527, ASSIGN}] 2023-11-18 00:54:47,490 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0035d1a377392eee8a165c72885c9527, ASSIGN 2023-11-18 00:54:47,491 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=0035d1a377392eee8a165c72885c9527, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:47,642 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0035d1a377392eee8a165c72885c9527, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:47,642 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700268887642"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268887642"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268887642"}]},"ts":"1700268887642"} 2023-11-18 00:54:47,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 0035d1a377392eee8a165c72885c9527, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:47,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 00:54:47,795 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:47,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:47,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0035d1a377392eee8a165c72885c9527, NAME => 'testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:54:47,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-18 00:54:47,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-18 00:54:47,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:47,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:47,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:47,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:47,800 INFO [StoreOpener-0035d1a377392eee8a165c72885c9527-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:47,802 DEBUG [StoreOpener-0035d1a377392eee8a165c72885c9527-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1 2023-11-18 00:54:47,802 DEBUG [StoreOpener-0035d1a377392eee8a165c72885c9527-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1 2023-11-18 00:54:47,802 INFO [StoreOpener-0035d1a377392eee8a165c72885c9527-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0035d1a377392eee8a165c72885c9527 columnFamilyName f1 2023-11-18 00:54:47,803 INFO [StoreOpener-0035d1a377392eee8a165c72885c9527-1] regionserver.HStore(310): Store=0035d1a377392eee8a165c72885c9527/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:47,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:47,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:47,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:47,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:47,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0035d1a377392eee8a165c72885c9527; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72968634, jitterRate=0.08731737732887268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:54:47,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0035d1a377392eee8a165c72885c9527: 2023-11-18 00:54:47,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527., pid=73, masterSystemTime=1700268887795 2023-11-18 00:54:47,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:47,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:47,810 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0035d1a377392eee8a165c72885c9527, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:47,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700268887810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268887810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268887810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268887810"}]},"ts":"1700268887810"} 2023-11-18 00:54:47,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-18 00:54:47,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 0035d1a377392eee8a165c72885c9527, server=jenkins-hbase4.apache.org,46287,1700268799711 in 168 msec 2023-11-18 00:54:47,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-18 00:54:47,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=0035d1a377392eee8a165c72885c9527, ASSIGN in 323 msec 2023-11-18 00:54:47,814 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:54:47,814 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268887814"}]},"ts":"1700268887814"} 2023-11-18 00:54:47,815 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-18 00:54:47,818 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:54:47,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1560 sec 2023-11-18 00:54:48,627 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-18 00:54:48,627 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-18 00:54:48,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 00:54:48,769 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-18 00:54:48,769 DEBUG [Listener at localhost/41175] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-18 00:54:48,771 INFO [Listener at localhost/41175] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-18 00:54:48,773 INFO [Listener at localhost/41175] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-18 00:54:48,774 INFO [Listener at localhost/41175] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-18 00:54:48,774 INFO [Listener at localhost/41175] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-18 00:54:48,778 INFO [Listener at localhost/41175] regionserver.HRegion(2745): Flushing 0035d1a377392eee8a165c72885c9527 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-18 00:54:49,189 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118f5af6d06699e4e2aa85f67604597f049 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118f5af6d06699e4e2aa85f67604597f049 2023-11-18 00:54:49,594 INFO [Listener at localhost/41175] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/.tmp/f1/2c8a7c42f38d4567a6f3c20af52d5bd7 2023-11-18 00:54:49,599 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/.tmp/f1/2c8a7c42f38d4567a6f3c20af52d5bd7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7 2023-11-18 00:54:49,602 INFO [Listener at localhost/41175] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7, entries=1, sequenceid=5, filesize=4.9 K 2023-11-18 00:54:49,603 INFO [Listener at localhost/41175] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 0035d1a377392eee8a165c72885c9527 in 825ms, sequenceid=5, compaction requested=false 2023-11-18 00:54:49,603 DEBUG [Listener at localhost/41175] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-18 00:54:49,604 DEBUG [Listener at localhost/41175] regionserver.HRegion(2446): Flush status journal for 0035d1a377392eee8a165c72885c9527: 2023-11-18 00:54:49,605 INFO [Listener at localhost/41175] regionserver.HRegion(2745): Flushing 0035d1a377392eee8a165c72885c9527 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-18 00:54:49,947 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:54:50,016 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118725ec5e81f6c4a0dac61ccf870794e5c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118725ec5e81f6c4a0dac61ccf870794e5c 2023-11-18 00:54:50,421 INFO [Listener at localhost/41175] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/.tmp/f1/8b554d6aad6b4528bd20d037b9fd1b48 2023-11-18 00:54:50,425 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/.tmp/f1/8b554d6aad6b4528bd20d037b9fd1b48 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48 2023-11-18 00:54:50,429 INFO [Listener at localhost/41175] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48, entries=1, sequenceid=9, filesize=4.9 K 2023-11-18 00:54:50,430 INFO [Listener at localhost/41175] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 0035d1a377392eee8a165c72885c9527 in 825ms, sequenceid=9, compaction requested=false 2023-11-18 00:54:50,430 DEBUG [Listener at localhost/41175] regionserver.HRegion(2446): Flush status journal for 0035d1a377392eee8a165c72885c9527: 2023-11-18 00:54:50,431 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-18 00:54:50,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-18 00:54:50,433 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-18 00:54:50,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:50,433 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269490433 2023-11-18 00:54:50,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 00:54:50,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-18 00:54:50,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-18 00:54:50,574 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-18 00:54:50,574 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28bd1eb6 to 127.0.0.1:58527 2023-11-18 00:54:50,574 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:50,574 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:50,574 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ec03414 to 127.0.0.1:58527 2023-11-18 00:54:50,574 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:50,575 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:54:50,575 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ecb18a5 to 127.0.0.1:58527 2023-11-18 00:54:50,575 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:54:50,575 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,575 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x12a7fd82 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:54:50,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3415e8ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:54:50,581 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='testGetAfterCompaction' and column='f1' 2023-11-18 00:54:50,626 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,626 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,677 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,677 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,727 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,727 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,778 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,778 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,829 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,829 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,880 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,880 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,930 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,930 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,981 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:50,981 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,032 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,032 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,082 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,082 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,133 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,133 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,183 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,183 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,234 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,234 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,285 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,285 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,335 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,335 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,386 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,386 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,405 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118c7eb341ab24a4ca59b14676ad76d1cb9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118c7eb341ab24a4ca59b14676ad76d1cb9 2023-11-18 00:54:51,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testGetAfterCompaction' column='f1' 2023-11-18 00:54:51,420 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:54:51,421 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:54:51,426 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:54:51,428 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:54:51,436 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/f1/5841c8555b3a4f56b9fba08b331b5c9a first=Optional[r1] last=Optional[r2] 2023-11-18 00:54:51,437 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{f1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/f1/5841c8555b3a4f56b9fba08b331b5c9a}] 2023-11-18 00:54:51,437 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,437 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/f1/5841c8555b3a4f56b9fba08b331b5c9a for inclusion in 0035d1a377392eee8a165c72885c9527/f1 2023-11-18 00:54:51,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-18 00:54:51,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:54:51,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 0035d1a377392eee8a165c72885c9527: 2023-11-18 00:54:51,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/f1/5841c8555b3a4f56b9fba08b331b5c9a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testGetAfterCompaction__5fbv5d45v7kp2llrfj459n3i9m64ffqt81m198f6nbmktes8r9cq3rv2s886m5bb/f1/5841c8555b3a4f56b9fba08b331b5c9a 2023-11-18 00:54:51,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testGetAfterCompaction__5fbv5d45v7kp2llrfj459n3i9m64ffqt81m198f6nbmktes8r9cq3rv2s886m5bb/f1/5841c8555b3a4f56b9fba08b331b5c9a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_ 2023-11-18 00:54:51,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testGetAfterCompaction__5fbv5d45v7kp2llrfj459n3i9m64ffqt81m198f6nbmktes8r9cq3rv2s886m5bb/f1/5841c8555b3a4f56b9fba08b331b5c9a into 0035d1a377392eee8a165c72885c9527/f1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_ - updating store file list. 2023-11-18 00:54:51,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_ into 0035d1a377392eee8a165c72885c9527/f1 2023-11-18 00:54:51,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testGetAfterCompaction__5fbv5d45v7kp2llrfj459n3i9m64ffqt81m198f6nbmktes8r9cq3rv2s886m5bb/f1/5841c8555b3a4f56b9fba08b331b5c9a into 0035d1a377392eee8a165c72885c9527/f1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_) 2023-11-18 00:54:51,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testGetAfterCompaction__5fbv5d45v7kp2llrfj459n3i9m64ffqt81m198f6nbmktes8r9cq3rv2s886m5bb/f1/5841c8555b3a4f56b9fba08b331b5c9a 2023-11-18 00:54:51,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(1912): 0035d1a377392eee8a165c72885c9527/f1 is initiating minor compaction 2023-11-18 00:54:51,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3bf174fa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:51,451 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0035d1a377392eee8a165c72885c9527/f1 in testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:51,451 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/.tmp, totalSize=10.0 K 2023-11-18 00:54:51,452 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 8b554d6aad6b4528bd20d037b9fd1b48, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 00:54:51,452 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 00:54:51,453 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testGetAfterCompaction' column='f1' 2023-11-18 00:54:51,454 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:51,456 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118725ec5e81f6c4a0dac61ccf870794e5c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118725ec5e81f6c4a0dac61ccf870794e5c 2023-11-18 00:54:51,457 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118f5af6d06699e4e2aa85f67604597f049 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118f5af6d06699e4e2aa85f67604597f049 2023-11-18 00:54:51,458 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-18 00:54:51,458 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 00:54:51,458 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='testGetAfterCompaction' and column='f1' 2023-11-18 00:54:51,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-18 00:54:51,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:54:51,459 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-18 00:54:51,461 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0035d1a377392eee8a165c72885c9527#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:54:51,461 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 1.0280 sec 2023-11-18 00:54:51,488 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,488 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,488 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,492 DEBUG [Listener at localhost/41175] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-18 00:54:51,496 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-18 00:54:51,496 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46287] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:51,497 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-18 00:54:51,497 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-18 00:54:51,497 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46287] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-18 00:54:51,497 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46287] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. because compaction request was cancelled 2023-11-18 00:54:51,549 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,549 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,549 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,600 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,600 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,600 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,651 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,651 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,651 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,702 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,702 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,702 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,753 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,753 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,753 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,803 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,804 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,804 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,854 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,854 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,854 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,905 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,905 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,905 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,956 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:51,956 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:51,956 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,007 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:52,007 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,007 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,058 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:52,058 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,058 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,108 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:52,109 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,109 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,159 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:52,160 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,160 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,210 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:52,210 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,210 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,261 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:52,261 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,261 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,274 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/.tmp/f1/74b9c7b257794379ba9c829c715bfe73 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/74b9c7b257794379ba9c829c715bfe73 2023-11-18 00:54:52,279 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 0035d1a377392eee8a165c72885c9527/f1 of 0035d1a377392eee8a165c72885c9527 into 74b9c7b257794379ba9c829c715bfe73(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:54:52,279 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0035d1a377392eee8a165c72885c9527: 2023-11-18 00:54:52,279 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1700268891451; duration=0sec 2023-11-18 00:54:52,279 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:54:52,312 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:52,312 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,312 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/74b9c7b257794379ba9c829c715bfe73; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700268892270; access_time=1700268891457; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,312 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,363 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700268891401; access_time=1700268890593; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 00:54:52,363 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,363 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/74b9c7b257794379ba9c829c715bfe73; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700268892270; access_time=1700268891457; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,363 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268890421; access_time=1700268889607; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_] to archive 2023-11-18 00:54:52,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:54:52,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/8b554d6aad6b4528bd20d037b9fd1b48 2023-11-18 00:54:52,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/1259aa8c8fef465b8a5570eca0aa5b40_SeqId_12_ 2023-11-18 00:54:52,413 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700268889594; access_time=1700268888780; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,413 INFO [Listener at localhost/41175] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/74b9c7b257794379ba9c829c715bfe73; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700268892270; access_time=1700268891457; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 00:54:52,530 INFO [Listener at localhost/41175] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-18 00:54:52,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-18 00:54:52,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-18 00:54:52,542 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268892542"}]},"ts":"1700268892542"} 2023-11-18 00:54:52,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-18 00:54:52,544 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-18 00:54:52,546 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-18 00:54:52,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0035d1a377392eee8a165c72885c9527, UNASSIGN}] 2023-11-18 00:54:52,549 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0035d1a377392eee8a165c72885c9527, UNASSIGN 2023-11-18 00:54:52,550 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0035d1a377392eee8a165c72885c9527, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:52,550 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700268892549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268892549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268892549"}]},"ts":"1700268892549"} 2023-11-18 00:54:52,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 0035d1a377392eee8a165c72885c9527, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:52,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-18 00:54:52,702 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:52,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:52,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0035d1a377392eee8a165c72885c9527, disabling compactions & flushes 2023-11-18 00:54:52,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:52,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:52,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. after waiting 0 ms 2023-11-18 00:54:52,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:52,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-18 00:54:52,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-18 00:54:52,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527. 2023-11-18 00:54:52,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0035d1a377392eee8a165c72885c9527: 2023-11-18 00:54:52,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:52,710 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0035d1a377392eee8a165c72885c9527, regionState=CLOSED 2023-11-18 00:54:52,710 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700268892710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268892710"}]},"ts":"1700268892710"} 2023-11-18 00:54:52,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-18 00:54:52,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 0035d1a377392eee8a165c72885c9527, server=jenkins-hbase4.apache.org,46287,1700268799711 in 160 msec 2023-11-18 00:54:52,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-18 00:54:52,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=0035d1a377392eee8a165c72885c9527, UNASSIGN in 166 msec 2023-11-18 00:54:52,715 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268892715"}]},"ts":"1700268892715"} 2023-11-18 00:54:52,716 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-18 00:54:52,718 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-18 00:54:52,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-11-18 00:54:52,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-18 00:54:52,845 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-18 00:54:52,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-18 00:54:52,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 00:54:52,856 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 00:54:52,858 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 00:54:52,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-18 00:54:52,860 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:52,862 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1, FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/recovered.edits] 2023-11-18 00:54:52,867 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/2c8a7c42f38d4567a6f3c20af52d5bd7 2023-11-18 00:54:52,868 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/74b9c7b257794379ba9c829c715bfe73 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/f1/74b9c7b257794379ba9c829c715bfe73 2023-11-18 00:54:52,871 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/recovered.edits/15.seqid to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527/recovered.edits/15.seqid 2023-11-18 00:54:52,871 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testGetAfterCompaction/0035d1a377392eee8a165c72885c9527 2023-11-18 00:54:52,871 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-18 00:54:52,872 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-18 00:54:52,873 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-18 00:54:52,876 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118c7eb341ab24a4ca59b14676ad76d1cb9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118c7eb341ab24a4ca59b14676ad76d1cb9 2023-11-18 00:54:52,876 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-18 00:54:52,878 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 00:54:52,904 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-18 00:54:52,906 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-18 00:54:52,907 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 00:54:52,907 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-18 00:54:52,908 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700268892907"}]},"ts":"9223372036854775807"} 2023-11-18 00:54:52,909 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-18 00:54:52,909 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0035d1a377392eee8a165c72885c9527, NAME => 'testGetAfterCompaction,,1700268886661.0035d1a377392eee8a165c72885c9527.', STARTKEY => '', ENDKEY => ''}] 2023-11-18 00:54:52,909 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-18 00:54:52,909 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1700268892909"}]},"ts":"9223372036854775807"} 2023-11-18 00:54:52,910 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-18 00:54:52,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 00:54:52,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 62 msec 2023-11-18 00:54:52,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-18 00:54:52,959 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-18 00:54:52,972 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 243), OpenFileDescriptor=620 (was 648), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=118 (was 128), ProcessCount=167 (was 167), AvailableMemoryMB=9190 (was 9242) 2023-11-18 00:54:52,982 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=118, ProcessCount=167, AvailableMemoryMB=9189 2023-11-18 00:54:52,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 00:54:52,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-18 00:54:52,985 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:54:52,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-18 00:54:52,985 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:54:52,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 00:54:52,987 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:52,987 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:52,987 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:52,988 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7 empty. 2023-11-18 00:54:52,988 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1 empty. 2023-11-18 00:54:52,988 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a empty. 2023-11-18 00:54:52,988 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:52,988 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:52,988 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:52,988 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-18 00:54:53,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 00:54:53,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 00:54:53,399 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-18 00:54:53,401 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => cfa25bcf33a8406213d9a872fe13b7d1, NAME => 'testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:53,401 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7303eedc2c2e47c9b75c5b6fa37c67a7, NAME => 'testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:53,401 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 442deadaba9fce82374166dd2c4e6d7a, NAME => 'testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:54:53,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 442deadaba9fce82374166dd2c4e6d7a, disabling compactions & flushes 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 7303eedc2c2e47c9b75c5b6fa37c67a7, disabling compactions & flushes 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:53,810 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing cfa25bcf33a8406213d9a872fe13b7d1, disabling compactions & flushes 2023-11-18 00:54:53,810 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:53,810 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. after waiting 0 ms 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. after waiting 0 ms 2023-11-18 00:54:53,810 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:53,810 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. after waiting 0 ms 2023-11-18 00:54:53,811 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:53,811 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:53,811 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:54:53,811 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:54:53,811 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:53,811 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:54:53,813 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:54:53,814 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268893813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268893813"}]},"ts":"1700268893813"} 2023-11-18 00:54:53,814 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268893813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268893813"}]},"ts":"1700268893813"} 2023-11-18 00:54:53,814 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268893813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268893813"}]},"ts":"1700268893813"} 2023-11-18 00:54:53,815 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 00:54:53,816 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:54:53,816 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268893816"}]},"ts":"1700268893816"} 2023-11-18 00:54:53,817 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-18 00:54:53,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, ASSIGN}] 2023-11-18 00:54:53,823 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, ASSIGN 2023-11-18 00:54:53,823 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, ASSIGN 2023-11-18 00:54:53,824 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, ASSIGN 2023-11-18 00:54:53,824 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:53,824 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:53,824 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:54:53,976 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=cfa25bcf33a8406213d9a872fe13b7d1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:53,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=442deadaba9fce82374166dd2c4e6d7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:53,976 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=7303eedc2c2e47c9b75c5b6fa37c67a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:53,976 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268893976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268893976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268893976"}]},"ts":"1700268893976"} 2023-11-18 00:54:53,976 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268893976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268893976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268893976"}]},"ts":"1700268893976"} 2023-11-18 00:54:53,976 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268893976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268893976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268893976"}]},"ts":"1700268893976"} 2023-11-18 00:54:53,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure cfa25bcf33a8406213d9a872fe13b7d1, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:53,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 442deadaba9fce82374166dd2c4e6d7a, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:53,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 7303eedc2c2e47c9b75c5b6fa37c67a7, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:54:54,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 00:54:54,130 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:54,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:54,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7303eedc2c2e47c9b75c5b6fa37c67a7, NAME => 'testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 00:54:54,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:54,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:54,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:54,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:54,134 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:54,135 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1 2023-11-18 00:54:54,135 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1 2023-11-18 00:54:54,135 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7303eedc2c2e47c9b75c5b6fa37c67a7 columnFamilyName family1 2023-11-18 00:54:54,137 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(310): Store=7303eedc2c2e47c9b75c5b6fa37c67a7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:54,137 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:54,138 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2 2023-11-18 00:54:54,138 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2 2023-11-18 00:54:54,138 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7303eedc2c2e47c9b75c5b6fa37c67a7 columnFamilyName family2 2023-11-18 00:54:54,139 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(310): Store=7303eedc2c2e47c9b75c5b6fa37c67a7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:54,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:54:54,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:54:54,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:54,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7303eedc2c2e47c9b75c5b6fa37c67a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72668462, jitterRate=0.08284446597099304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:54:54,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:54:54,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7., pid=85, masterSystemTime=1700268894130 2023-11-18 00:54:54,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:54,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:54,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:54,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cfa25bcf33a8406213d9a872fe13b7d1, NAME => 'testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 00:54:54,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:54,147 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=7303eedc2c2e47c9b75c5b6fa37c67a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:54,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:54,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:54,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:54,147 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268894147"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268894147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268894147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268894147"}]},"ts":"1700268894147"} 2023-11-18 00:54:54,148 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:54,149 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1 2023-11-18 00:54:54,149 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1 2023-11-18 00:54:54,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=80 2023-11-18 00:54:54,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 7303eedc2c2e47c9b75c5b6fa37c67a7, server=jenkins-hbase4.apache.org,46287,1700268799711 in 170 msec 2023-11-18 00:54:54,149 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfa25bcf33a8406213d9a872fe13b7d1 columnFamilyName family1 2023-11-18 00:54:54,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, ASSIGN in 328 msec 2023-11-18 00:54:54,150 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(310): Store=cfa25bcf33a8406213d9a872fe13b7d1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:54,150 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:54,151 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2 2023-11-18 00:54:54,151 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2 2023-11-18 00:54:54,152 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfa25bcf33a8406213d9a872fe13b7d1 columnFamilyName family2 2023-11-18 00:54:54,152 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(310): Store=cfa25bcf33a8406213d9a872fe13b7d1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:54,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:54,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:54,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:54:54,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:54:54,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:54,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cfa25bcf33a8406213d9a872fe13b7d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61535546, jitterRate=-0.08304890990257263}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:54:54,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:54:54,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1., pid=83, masterSystemTime=1700268894130 2023-11-18 00:54:54,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:54,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:54,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:54,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 442deadaba9fce82374166dd2c4e6d7a, NAME => 'testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 00:54:54,159 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=cfa25bcf33a8406213d9a872fe13b7d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:54,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:54,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:54:54,159 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268894159"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268894159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268894159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268894159"}]},"ts":"1700268894159"} 2023-11-18 00:54:54,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:54,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:54,160 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:54,161 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1 2023-11-18 00:54:54,161 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1 2023-11-18 00:54:54,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=82 2023-11-18 00:54:54,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure cfa25bcf33a8406213d9a872fe13b7d1, server=jenkins-hbase4.apache.org,46287,1700268799711 in 183 msec 2023-11-18 00:54:54,161 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 442deadaba9fce82374166dd2c4e6d7a columnFamilyName family1 2023-11-18 00:54:54,162 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(310): Store=442deadaba9fce82374166dd2c4e6d7a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:54,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, ASSIGN in 339 msec 2023-11-18 00:54:54,163 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:54,163 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2 2023-11-18 00:54:54,163 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2 2023-11-18 00:54:54,164 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 442deadaba9fce82374166dd2c4e6d7a columnFamilyName family2 2023-11-18 00:54:54,164 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(310): Store=442deadaba9fce82374166dd2c4e6d7a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:54:54,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:54,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:54,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:54:54,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:54:54,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:54:54,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 442deadaba9fce82374166dd2c4e6d7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70140679, jitterRate=0.04517756402492523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:54:54,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:54:54,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a., pid=84, masterSystemTime=1700268894130 2023-11-18 00:54:54,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:54,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:54,172 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=442deadaba9fce82374166dd2c4e6d7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:54,172 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268894172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268894172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268894172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268894172"}]},"ts":"1700268894172"} 2023-11-18 00:54:54,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-11-18 00:54:54,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 442deadaba9fce82374166dd2c4e6d7a, server=jenkins-hbase4.apache.org,46287,1700268799711 in 195 msec 2023-11-18 00:54:54,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=79 2023-11-18 00:54:54,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, ASSIGN in 353 msec 2023-11-18 00:54:54,176 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:54:54,176 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268894176"}]},"ts":"1700268894176"} 2023-11-18 00:54:54,177 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-18 00:54:54,179 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:54:54,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1960 sec 2023-11-18 00:54:55,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 00:54:55,091 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-18 00:54:55,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:55,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:55,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:55,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:55,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 00:54:55,104 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 00:54:55,104 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:55,104 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 00:54:55,104 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 00:54:55,104 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:55,104 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:55,106 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:55,106 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:55,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:55,106 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:55,106 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:55,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:55,107 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 00:54:55,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 00:54:55,107 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 00:54:55,107 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:55,107 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 00:54:55,107 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:55,107 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. started... 2023-11-18 00:54:55,107 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:54:55,108 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:55,108 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7303eedc2c2e47c9b75c5b6fa37c67a7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:54:55,107 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:55,108 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:55,108 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. started... 2023-11-18 00:54:55,108 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. started... 2023-11-18 00:54:55,109 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfa25bcf33a8406213d9a872fe13b7d1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:54:55,109 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 442deadaba9fce82374166dd2c4e6d7a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:54:55,523 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2 2023-11-18 00:54:55,523 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5 2023-11-18 00:54:55,523 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985 2023-11-18 00:54:55,928 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/94c8b9ad46614e6d8796f2687ac8e3e7 2023-11-18 00:54:55,929 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/96bbe44d8d9941d7a26822d1a731a53d 2023-11-18 00:54:55,929 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/08e5ac76d4b74b2d979463e33a216ae6 2023-11-18 00:54:55,952 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118de38be1aa3a041bcb7794a51527201b0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118de38be1aa3a041bcb7794a51527201b0 2023-11-18 00:54:56,353 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118ac5ac06a69b24b3199984acb44637b39 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118ac5ac06a69b24b3199984acb44637b39 2023-11-18 00:54:56,353 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111886af3e1ea8954a04b9b9069f6b4f2276 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111886af3e1ea8954a04b9b9069f6b4f2276 2023-11-18 00:54:56,357 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/d567fe7d0edc4218a7a55e7950449345 2023-11-18 00:54:56,362 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/94c8b9ad46614e6d8796f2687ac8e3e7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/94c8b9ad46614e6d8796f2687ac8e3e7 2023-11-18 00:54:56,366 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/94c8b9ad46614e6d8796f2687ac8e3e7, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 00:54:56,367 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/d567fe7d0edc4218a7a55e7950449345 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d567fe7d0edc4218a7a55e7950449345 2023-11-18 00:54:56,371 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d567fe7d0edc4218a7a55e7950449345, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:54:56,372 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 442deadaba9fce82374166dd2c4e6d7a in 1263ms, sequenceid=5, compaction requested=false 2023-11-18 00:54:56,372 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-18 00:54:56,373 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:54:56,373 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:56,373 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:54:56,760 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0 2023-11-18 00:54:56,760 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/bb828e9bf7274ca0881069b84580cb39 2023-11-18 00:54:56,764 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/08e5ac76d4b74b2d979463e33a216ae6 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/08e5ac76d4b74b2d979463e33a216ae6 2023-11-18 00:54:56,764 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/96bbe44d8d9941d7a26822d1a731a53d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/96bbe44d8d9941d7a26822d1a731a53d 2023-11-18 00:54:56,768 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/08e5ac76d4b74b2d979463e33a216ae6, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 00:54:56,768 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/96bbe44d8d9941d7a26822d1a731a53d, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 00:54:56,768 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0 2023-11-18 00:54:56,768 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/bb828e9bf7274ca0881069b84580cb39 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/bb828e9bf7274ca0881069b84580cb39 2023-11-18 00:54:56,772 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:54:56,773 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/bb828e9bf7274ca0881069b84580cb39, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:54:56,773 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7303eedc2c2e47c9b75c5b6fa37c67a7 in 1665ms, sequenceid=5, compaction requested=false 2023-11-18 00:54:56,774 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:54:56,774 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:56,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:54:56,774 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cfa25bcf33a8406213d9a872fe13b7d1 in 1665ms, sequenceid=5, compaction requested=false 2023-11-18 00:54:56,774 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:54:56,774 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:56,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:54:56,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:54:56,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 00:54:56,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 00:54:56,776 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:56,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:56,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:56,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:56,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:56,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:56,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:56,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:56,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:56,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 00:54:56,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e8832a4[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:56,778 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 00:54:56,778 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:56,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:56,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:56,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 00:54:56,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 00:54:56,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:56,779 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,779 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:56,781 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 00:54:56,781 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,781 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:56,781 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 00:54:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:56,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 00:54:56,783 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 00:54:56,783 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:56,783 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:56,783 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 00:54:56,784 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:56,785 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,785 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:56,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:56,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,785 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:56,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:56,785 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:56,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:56,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:56,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:56,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:56,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,787 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:56,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:56,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,789 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,789 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:56,789 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:56,789 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:56,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:56,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:56,789 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:56,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 00:54:56,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:56,789 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:56,789 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,790 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:56,790 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:56,790 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:56,790 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:56,790 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:56,890 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:56,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:56,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:56,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:56,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:56,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:56,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:56,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 00:54:56,897 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 00:54:56,897 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:56,897 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 00:54:56,897 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 00:54:56,898 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,898 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:56,900 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:56,900 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:56,901 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:56,901 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:56,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:56,902 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 00:54:56,902 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-18 00:54:56,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 00:54:56,902 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 00:54:56,902 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:56,902 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 00:54:56,902 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:56,902 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. started... 2023-11-18 00:54:56,903 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:54:56,903 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:56,903 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7303eedc2c2e47c9b75c5b6fa37c67a7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:54:56,903 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. started... 2023-11-18 00:54:56,903 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. started... 2023-11-18 00:54:56,903 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 442deadaba9fce82374166dd2c4e6d7a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:54:56,903 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfa25bcf33a8406213d9a872fe13b7d1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:54:57,322 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e 2023-11-18 00:54:57,323 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e 2023-11-18 00:54:57,323 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234 2023-11-18 00:54:57,731 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/27088c31b03d43aeb9ef655978ddcaac 2023-11-18 00:54:57,731 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/01ca07db7a334b5da1cb7b7bbb71d185 2023-11-18 00:54:57,731 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/d7fa18d64950477f98a9b20d51b6ca8b 2023-11-18 00:54:58,151 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111869b44a03da76467b93015cf13b02ddba to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111869b44a03da76467b93015cf13b02ddba 2023-11-18 00:54:58,152 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311182f50e14cf86b44de8f5f02bf7022389c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311182f50e14cf86b44de8f5f02bf7022389c 2023-11-18 00:54:58,153 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111881eb7e3698bd4cdf99b120c6e2e43bda to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111881eb7e3698bd4cdf99b120c6e2e43bda 2023-11-18 00:54:58,162 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/7c8cc1644db0418abf429b716ab53965 2023-11-18 00:54:58,167 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/27088c31b03d43aeb9ef655978ddcaac as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/27088c31b03d43aeb9ef655978ddcaac 2023-11-18 00:54:58,172 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/27088c31b03d43aeb9ef655978ddcaac, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 00:54:58,172 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/7c8cc1644db0418abf429b716ab53965 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/7c8cc1644db0418abf429b716ab53965 2023-11-18 00:54:58,176 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/7c8cc1644db0418abf429b716ab53965, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:54:58,177 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7303eedc2c2e47c9b75c5b6fa37c67a7 in 1274ms, sequenceid=9, compaction requested=false 2023-11-18 00:54:58,177 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:54:58,177 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:58,177 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:54:58,210 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:54:58,558 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/2f4d03df7c6f4811b775008bd7b5b56b 2023-11-18 00:54:58,561 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/a2dbfbf01a384ad29818ea368842e94d 2023-11-18 00:54:58,563 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/d7fa18d64950477f98a9b20d51b6ca8b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/d7fa18d64950477f98a9b20d51b6ca8b 2023-11-18 00:54:58,568 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/d7fa18d64950477f98a9b20d51b6ca8b, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 00:54:58,569 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/2f4d03df7c6f4811b775008bd7b5b56b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2f4d03df7c6f4811b775008bd7b5b56b 2023-11-18 00:54:58,569 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/01ca07db7a334b5da1cb7b7bbb71d185 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/01ca07db7a334b5da1cb7b7bbb71d185 2023-11-18 00:54:58,573 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2f4d03df7c6f4811b775008bd7b5b56b, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:54:58,573 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/01ca07db7a334b5da1cb7b7bbb71d185, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 00:54:58,574 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/a2dbfbf01a384ad29818ea368842e94d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/a2dbfbf01a384ad29818ea368842e94d 2023-11-18 00:54:58,579 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/a2dbfbf01a384ad29818ea368842e94d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:54:58,581 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 442deadaba9fce82374166dd2c4e6d7a in 1678ms, sequenceid=9, compaction requested=false 2023-11-18 00:54:58,581 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cfa25bcf33a8406213d9a872fe13b7d1 in 1678ms, sequenceid=9, compaction requested=false 2023-11-18 00:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:58,581 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:54:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:54:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:54:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 00:54:58,581 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 00:54:58,586 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:58,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:58,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:58,587 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:54:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:58,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:58,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 00:54:58,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a578b05[Count = 0] remaining members to acquire global barrier 2023-11-18 00:54:58,590 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 00:54:58,590 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:58,591 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:58,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:58,591 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 00:54:58,591 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 00:54:58,591 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:54:58,591 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,591 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:54:58,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 00:54:58,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:58,593 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,593 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 00:54:58,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:58,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:54:58,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 00:54:58,596 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 00:54:58,596 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:54:58,596 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:54:58,596 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 00:54:58,596 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:54:58,597 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,597 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:58,597 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:54:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:54:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:54:58,598 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:58,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:54:58,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:58,599 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:54:58,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:54:58,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,602 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,602 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:58,602 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:58,602 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,602 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:58,602 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:54:58,602 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:54:58,603 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:58,603 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:58,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:58,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 00:54:58,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:54:58,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-18 00:54:58,603 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:54:58,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:54:58,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:54:58,603 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 00:54:58,603 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:54:58,627 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-18 00:54:58,703 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:54:58,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:54:58,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:58,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:58,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:54:58,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:54:58,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-18 00:54:58,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 00:54:58,711 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 00:54:58,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:58,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 00:54:58,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 00:54:58,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,711 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:58,713 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:54:58,713 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:54:58,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:54:58,713 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:54:58,713 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:54:58,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:58,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:54:58,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:54:58,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:54:58,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 00:54:58,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-18 00:54:58,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 00:54:58,714 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 00:54:58,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:54:58,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 00:54:58,715 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:58,715 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. started... 2023-11-18 00:54:58,715 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:54:58,715 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. started... 2023-11-18 00:54:58,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:54:58,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:54:58,715 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 442deadaba9fce82374166dd2c4e6d7a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:54:58,715 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7303eedc2c2e47c9b75c5b6fa37c67a7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:54:58,715 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:54:58,715 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. started... 2023-11-18 00:54:58,715 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfa25bcf33a8406213d9a872fe13b7d1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:54:59,128 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849 2023-11-18 00:54:59,136 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd 2023-11-18 00:54:59,150 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed 2023-11-18 00:54:59,533 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/5a8894ca4545419887a124e3a13168f5 2023-11-18 00:54:59,540 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/813dda4be0644adb89b282d3239d7c5a 2023-11-18 00:54:59,557 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/da04a313a3de40b0999c0913a74dcd53 2023-11-18 00:54:59,946 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311185a91b87d91974eceb6cc274ca0ae1465 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311185a91b87d91974eceb6cc274ca0ae1465 2023-11-18 00:54:59,952 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311183478007188b842c7866227ef7cf2d794 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311183478007188b842c7866227ef7cf2d794 2023-11-18 00:54:59,971 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118c73272c5b5454ae2bf9b5ebeec923e75 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c73272c5b5454ae2bf9b5ebeec923e75 2023-11-18 00:54:59,975 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/a4913979410f4abfab4bd5115f84cc29 2023-11-18 00:54:59,978 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/da04a313a3de40b0999c0913a74dcd53 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/da04a313a3de40b0999c0913a74dcd53 2023-11-18 00:54:59,982 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/da04a313a3de40b0999c0913a74dcd53, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 00:54:59,982 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/a4913979410f4abfab4bd5115f84cc29 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/a4913979410f4abfab4bd5115f84cc29 2023-11-18 00:54:59,985 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/a4913979410f4abfab4bd5115f84cc29, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:54:59,986 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7303eedc2c2e47c9b75c5b6fa37c67a7 in 1271ms, sequenceid=13, compaction requested=true 2023-11-18 00:54:59,986 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:54:59,986 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:54:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:00,351 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/86a1eacd04814518bf608cf9947b75b4 2023-11-18 00:55:00,356 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/5a8894ca4545419887a124e3a13168f5 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/5a8894ca4545419887a124e3a13168f5 2023-11-18 00:55:00,356 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/82db48fc1ec844288c9e0f19f1139e40 2023-11-18 00:55:00,362 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/813dda4be0644adb89b282d3239d7c5a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/813dda4be0644adb89b282d3239d7c5a 2023-11-18 00:55:00,363 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/5a8894ca4545419887a124e3a13168f5, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 00:55:00,364 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/86a1eacd04814518bf608cf9947b75b4 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/86a1eacd04814518bf608cf9947b75b4 2023-11-18 00:55:00,369 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/813dda4be0644adb89b282d3239d7c5a, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 00:55:00,369 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/86a1eacd04814518bf608cf9947b75b4, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:55:00,370 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/82db48fc1ec844288c9e0f19f1139e40 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/82db48fc1ec844288c9e0f19f1139e40 2023-11-18 00:55:00,370 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cfa25bcf33a8406213d9a872fe13b7d1 in 1655ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:00,370 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:00,370 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:00,371 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:00,374 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/82db48fc1ec844288c9e0f19f1139e40, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:55:00,375 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 442deadaba9fce82374166dd2c4e6d7a in 1660ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:00,375 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:00,375 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:00,375 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:00,375 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:00,375 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,375 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 00:55:00,375 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 00:55:00,377 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:00,377 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:00,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:00,377 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:00,377 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:00,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:00,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:00,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:00,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:00,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 00:55:00,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62d0644[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:00,379 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 00:55:00,379 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:00,382 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:00,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:00,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:00,382 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 00:55:00,382 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,382 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:00,382 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 00:55:00,383 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:00,384 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 00:55:00,384 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,384 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:00,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,384 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 00:55:00,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:00,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:00,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:00,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:00,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:00,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:00,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:00,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:00,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 00:55:00,388 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 00:55:00,388 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:00,388 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:00,388 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 00:55:00,388 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:00,391 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,391 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:00,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:00,391 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:00,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:00,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:00,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:00,392 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:00,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:00,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,398 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,398 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:00,398 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:00,398 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:00,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:00,398 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:00,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 00:55:00,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:00,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:00,399 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:00,398 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,399 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:00,399 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:00,399 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,399 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:00,399 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:00,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:00,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:00,499 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:00,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:00,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:00,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:00,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:00,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:00,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:00,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 00:55:00,512 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 00:55:00,512 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:00,513 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 00:55:00,513 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 00:55:00,513 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,513 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:00,516 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,516 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:00,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:00,516 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:00,516 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:00,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:00,517 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 00:55:00,518 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-18 00:55:00,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 00:55:00,518 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 00:55:00,518 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:00,518 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 00:55:00,518 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:00,518 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. started... 2023-11-18 00:55:00,518 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:00,518 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. started... 2023-11-18 00:55:00,518 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:00,518 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:00,518 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:00,518 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 442deadaba9fce82374166dd2c4e6d7a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:00,518 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. started... 2023-11-18 00:55:00,518 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfa25bcf33a8406213d9a872fe13b7d1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:00,519 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7303eedc2c2e47c9b75c5b6fa37c67a7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:00,944 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535 2023-11-18 00:55:00,944 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279 2023-11-18 00:55:00,944 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c 2023-11-18 00:55:01,350 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/263a1dbd5a294a08b43db97afe0128ef 2023-11-18 00:55:01,350 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/ea672d23bb424cfba0b0e1abcc5f4bbb 2023-11-18 00:55:01,350 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/5a29fca910e34e7da53083b89d144603 2023-11-18 00:55:01,765 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118b9a2998bd85b448ca8f91fe7d113c027 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9a2998bd85b448ca8f91fe7d113c027 2023-11-18 00:55:01,765 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118e57490cef922413c9000b658e147b028 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e57490cef922413c9000b658e147b028 2023-11-18 00:55:01,765 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118c18123d480c34ffaa43bf18f84f2008f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c18123d480c34ffaa43bf18f84f2008f 2023-11-18 00:55:02,170 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/4b184040f04c46308a3d217275349b26 2023-11-18 00:55:02,170 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/74df5584be5a4eb098ade8ac332af1c8 2023-11-18 00:55:02,170 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/1ddb43c04ff54d2a843b199ad0ec07e9 2023-11-18 00:55:02,175 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/263a1dbd5a294a08b43db97afe0128ef as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/263a1dbd5a294a08b43db97afe0128ef 2023-11-18 00:55:02,175 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/5a29fca910e34e7da53083b89d144603 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/5a29fca910e34e7da53083b89d144603 2023-11-18 00:55:02,176 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/ea672d23bb424cfba0b0e1abcc5f4bbb as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ea672d23bb424cfba0b0e1abcc5f4bbb 2023-11-18 00:55:02,179 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/263a1dbd5a294a08b43db97afe0128ef, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 00:55:02,180 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/74df5584be5a4eb098ade8ac332af1c8 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/74df5584be5a4eb098ade8ac332af1c8 2023-11-18 00:55:02,180 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/5a29fca910e34e7da53083b89d144603, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 00:55:02,180 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ea672d23bb424cfba0b0e1abcc5f4bbb, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 00:55:02,181 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/1ddb43c04ff54d2a843b199ad0ec07e9 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/1ddb43c04ff54d2a843b199ad0ec07e9 2023-11-18 00:55:02,182 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/4b184040f04c46308a3d217275349b26 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/4b184040f04c46308a3d217275349b26 2023-11-18 00:55:02,188 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/74df5584be5a4eb098ade8ac332af1c8, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:02,188 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/1ddb43c04ff54d2a843b199ad0ec07e9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:02,188 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 442deadaba9fce82374166dd2c4e6d7a in 1670ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:02,188 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7303eedc2c2e47c9b75c5b6fa37c67a7 in 1670ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:02,188 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:02,189 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:02,189 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:02,189 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:02,189 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:02,189 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:02,193 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/4b184040f04c46308a3d217275349b26, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:02,194 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cfa25bcf33a8406213d9a872fe13b7d1 in 1676ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:02,194 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:02,194 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:02,194 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:02,194 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:02,194 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,194 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 00:55:02,194 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 00:55:02,196 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,196 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:02,196 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:02,196 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:02,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:02,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:02,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 00:55:02,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49b68a53[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:02,197 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 00:55:02,197 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:02,200 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:02,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:02,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:02,200 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 00:55:02,200 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 00:55:02,200 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:02,200 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,200 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:02,201 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 00:55:02,201 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:02,201 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,201 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 00:55:02,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:02,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:02,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:02,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:02,203 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 00:55:02,203 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:02,203 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:02,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 00:55:02,203 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 00:55:02,203 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:02,205 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:02,205 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:02,205 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:02,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:02,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:02,205 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:02,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:02,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:02,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:02,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:02,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,207 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:02,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:02,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:02,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:02,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:02,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:02,209 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:02,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:02,210 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:02,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:02,210 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:02,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:02,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:02,310 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:02,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:02,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 00:55:02,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700268902320 (current time:1700268902320). 2023-11-18 00:55:02,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-18 00:55:02,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] zookeeper.ReadOnlyZKClient(139): Connect 0x66a59285 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:55:02,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@780b00bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:55:02,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:55:02,336 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:55:02,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66a59285 to 127.0.0.1:58527 2023-11-18 00:55:02,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:55:02,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-18 00:55:02,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 00:55:02,346 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot, current working dir path: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/snaptb-1700268902311 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-18 00:55:02,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 00:55:02,356 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 00:55:02,357 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700269502357 2023-11-18 00:55:02,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 00:55:02,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1700268902311 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-18 00:55:02,358 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 00:55:02,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-18 00:55:02,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-18 00:55:02,360 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-18 00:55:02,360 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1700269502360 2023-11-18 00:55:02,362 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:02,362 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-18 00:55:02,462 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:02,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:02,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 00:55:02,466 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-18 00:55:02,666 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:02,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:02,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 00:55:02,667 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-18 00:55:02,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1700268902311 2023-11-18 00:55:02,768 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1700268902311' 2023-11-18 00:55:02,768 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-18 00:55:02,768 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1700268902311' starting 'acquire' 2023-11-18 00:55:02,768 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1700268902311', kicking off acquire phase on members. 2023-11-18 00:55:02,769 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:02,769 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1700268902311 2023-11-18 00:55:02,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-18 00:55:02,770 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-18 00:55:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-18 00:55:02,771 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,771 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1700268902311 2023-11-18 00:55:02,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-18 00:55:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1700268902311 2023-11-18 00:55:02,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1700268902311 from table testCompactionWithHFileLink type FLUSH 2023-11-18 00:55:02,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1700268902311 2023-11-18 00:55:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1700268902311' with timeout 300000ms 2023-11-18 00:55:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-18 00:55:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1700268902311' starting 'acquire' stage 2023-11-18 00:55:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1700268902311' locally acquired 2023-11-18 00:55:02,774 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (snaptb-1700268902311) in zk 2023-11-18 00:55:02,775 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,775 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1700268902311 2023-11-18 00:55:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:02,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-18 00:55:02,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700268902311 2023-11-18 00:55:02,776 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1700268902311' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:02,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700268902311 2023-11-18 00:55:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:02,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'snaptb-1700268902311' on coordinator 2023-11-18 00:55:02,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66848cd3[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:02,777 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1700268902311' starting 'in-barrier' execution. 2023-11-18 00:55:02,777 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1700268902311 2023-11-18 00:55:02,779 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700268902311 2023-11-18 00:55:02,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1700268902311 2023-11-18 00:55:02,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1700268902311 2023-11-18 00:55:02,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1700268902311' received 'reached' from coordinator. 2023-11-18 00:55:02,779 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:02,779 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:02,780 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:02,780 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:02,780 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:02,780 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-18 00:55:02,780 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-18 00:55:02,781 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. started... 2023-11-18 00:55:02,781 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. started... 2023-11-18 00:55:02,781 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. started... 2023-11-18 00:55:02,781 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:02,781 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:02,781 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:02,782 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.' region-info for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,782 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.' region-info for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,782 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.' region-info for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,787 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-18 00:55:02,787 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-18 00:55:02,787 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-18 00:55:02,790 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/94c8b9ad46614e6d8796f2687ac8e3e7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/d7fa18d64950477f98a9b20d51b6ca8b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/813dda4be0644adb89b282d3239d7c5a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/5a29fca910e34e7da53083b89d144603] hfiles 2023-11-18 00:55:02,790 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/08e5ac76d4b74b2d979463e33a216ae6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/27088c31b03d43aeb9ef655978ddcaac, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/da04a313a3de40b0999c0913a74dcd53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/263a1dbd5a294a08b43db97afe0128ef] hfiles 2023-11-18 00:55:02,790 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/96bbe44d8d9941d7a26822d1a731a53d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/01ca07db7a334b5da1cb7b7bbb71d185, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/5a8894ca4545419887a124e3a13168f5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ea672d23bb424cfba0b0e1abcc5f4bbb] hfiles 2023-11-18 00:55:02,790 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/08e5ac76d4b74b2d979463e33a216ae6 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,790 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/94c8b9ad46614e6d8796f2687ac8e3e7 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,790 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/96bbe44d8d9941d7a26822d1a731a53d for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/d7fa18d64950477f98a9b20d51b6ca8b for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/27088c31b03d43aeb9ef655978ddcaac for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/01ca07db7a334b5da1cb7b7bbb71d185 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/da04a313a3de40b0999c0913a74dcd53 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/813dda4be0644adb89b282d3239d7c5a for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/263a1dbd5a294a08b43db97afe0128ef for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/5a29fca910e34e7da53083b89d144603 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/5a8894ca4545419887a124e3a13168f5 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d567fe7d0edc4218a7a55e7950449345, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2f4d03df7c6f4811b775008bd7b5b56b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/82db48fc1ec844288c9e0f19f1139e40, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/1ddb43c04ff54d2a843b199ad0ec07e9] hfiles 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d567fe7d0edc4218a7a55e7950449345 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/7c8cc1644db0418abf429b716ab53965, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/a4913979410f4abfab4bd5115f84cc29, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/74df5584be5a4eb098ade8ac332af1c8] hfiles 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ea672d23bb424cfba0b0e1abcc5f4bbb for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/7c8cc1644db0418abf429b716ab53965 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2f4d03df7c6f4811b775008bd7b5b56b for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/a4913979410f4abfab4bd5115f84cc29 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/bb828e9bf7274ca0881069b84580cb39, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/a2dbfbf01a384ad29818ea368842e94d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/86a1eacd04814518bf608cf9947b75b4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/4b184040f04c46308a3d217275349b26] hfiles 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/74df5584be5a4eb098ade8ac332af1c8 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/82db48fc1ec844288c9e0f19f1139e40 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/bb828e9bf7274ca0881069b84580cb39 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/1ddb43c04ff54d2a843b199ad0ec07e9 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,794 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/a2dbfbf01a384ad29818ea368842e94d for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,795 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/86a1eacd04814518bf608cf9947b75b4 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,795 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/4b184040f04c46308a3d217275349b26 for snapshot=snaptb-1700268902311 2023-11-18 00:55:02,803 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. completed. 2023-11-18 00:55:02,803 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:02,804 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-18 00:55:02,967 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:02,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:02,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 00:55:02,968 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-18 00:55:03,202 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. completed. 2023-11-18 00:55:03,202 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-18 00:55:03,203 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. completed. 2023-11-18 00:55:03,203 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-18 00:55:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-18 00:55:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1700268902311' locally completed 2023-11-18 00:55:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1700268902311' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:03,205 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,205 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1700268902311' has notified controller of completion 2023-11-18 00:55:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-18 00:55:03,205 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:03,205 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1700268902311' completed. 2023-11-18 00:55:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700268902311 2023-11-18 00:55:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700268902311 2023-11-18 00:55:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1700268902311' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:03,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'snaptb-1700268902311', counting down latch. Waiting for 0 more 2023-11-18 00:55:03,208 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1700268902311' execution completed 2023-11-18 00:55:03,208 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:03,208 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:03,208 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1700268902311 2023-11-18 00:55:03,208 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1700268902311including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-18 00:55:03,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:03,209 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-18 00:55:03,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:03,210 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-18 00:55:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:03,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-18 00:55:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-18 00:55:03,210 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700268902311 2023-11-18 00:55:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700268902311 2023-11-18 00:55:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,211 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700268902311 2023-11-18 00:55:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-18 00:55:03,215 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1700268902311 2023-11-18 00:55:03,215 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:03,215 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700268902311 2023-11-18 00:55:03,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-18 00:55:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700268902311 2023-11-18 00:55:03,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1700268902311 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700268902311/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:03,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700268902311 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700268902311 2023-11-18 00:55:03,215 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700268902311 2023-11-18 00:55:03,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-18 00:55:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-18 00:55:03,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed] mob files 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535 2023-11-18 00:55:03,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311182f50e14cf86b44de8f5f02bf7022389c, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311183478007188b842c7866227ef7cf2d794, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9a2998bd85b448ca8f91fe7d113c027, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118de38be1aa3a041bcb7794a51527201b0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311185a91b87d91974eceb6cc274ca0ae1465, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111869b44a03da76467b93015cf13b02ddba, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111886af3e1ea8954a04b9b9069f6b4f2276, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e57490cef922413c9000b658e147b028, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111881eb7e3698bd4cdf99b120c6e2e43bda, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118ac5ac06a69b24b3199984acb44637b39, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c18123d480c34ffaa43bf18f84f2008f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c73272c5b5454ae2bf9b5ebeec923e75] mob files 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311182f50e14cf86b44de8f5f02bf7022389c 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311183478007188b842c7866227ef7cf2d794 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9a2998bd85b448ca8f91fe7d113c027 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118de38be1aa3a041bcb7794a51527201b0 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311185a91b87d91974eceb6cc274ca0ae1465 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111869b44a03da76467b93015cf13b02ddba 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111886af3e1ea8954a04b9b9069f6b4f2276 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e57490cef922413c9000b658e147b028 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111881eb7e3698bd4cdf99b120c6e2e43bda 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118ac5ac06a69b24b3199984acb44637b39 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c18123d480c34ffaa43bf18f84f2008f 2023-11-18 00:55:03,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c73272c5b5454ae2bf9b5ebeec923e75 2023-11-18 00:55:03,469 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:03,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:03,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 00:55:03,470 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-18 00:55:03,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1700268902311 2023-11-18 00:55:03,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/snaptb-1700268902311 2023-11-18 00:55:04,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/snaptb-1700268902311 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/snaptb-1700268902311 2023-11-18 00:55:04,072 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1700268902311 of table testCompactionWithHFileLink completed 2023-11-18 00:55:04,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/snaptb-1700268902311 2023-11-18 00:55:04,073 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/snaptb-1700268902311 2023-11-18 00:55:04,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1700268902311 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700268902357Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1700268903623 (+1266 ms)Consolidate snapshot: snaptb-1700268902311 at 1700268903623Loading Region manifests for snaptb-1700268902311 at 1700268903623Writing data manifest for snaptb-1700268902311 at 1700268903633 (+10 ms)Verifying snapshot: snaptb-1700268902311 at 1700268904039 (+406 ms)Snapshot snaptb-1700268902311 of table testCompactionWithHFileLink completed at 1700268904072 (+33 ms) 2023-11-18 00:55:04,074 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-18 00:55:04,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7160 sec 2023-11-18 00:55:04,129 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:55:04,470 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:04,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:04,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-18 00:55:04,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:04,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:04,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 00:55:04,503 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 00:55:04,503 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:04,503 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 00:55:04,503 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 00:55:04,504 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:04,504 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:04,505 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:04,505 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:04,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:04,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:04,506 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:04,506 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:04,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:04,506 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 00:55:04,507 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-18 00:55:04,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 00:55:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 00:55:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 00:55:04,507 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:04,507 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:04,507 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:04,507 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. started... 2023-11-18 00:55:04,507 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:04,507 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. started... 2023-11-18 00:55:04,507 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. started... 2023-11-18 00:55:04,507 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfa25bcf33a8406213d9a872fe13b7d1 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:04,507 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7303eedc2c2e47c9b75c5b6fa37c67a7 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:04,507 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 442deadaba9fce82374166dd2c4e6d7a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:04,925 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/fe0ce09e76cd45c0974cf6dba615de27 2023-11-18 00:55:04,928 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/807e8ef37b5141268d15ae6495bedd58 2023-11-18 00:55:04,928 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe0ce09e76cd45c0974cf6dba615de27 2023-11-18 00:55:04,931 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 807e8ef37b5141268d15ae6495bedd58 2023-11-18 00:55:04,941 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/3ae1bdf79fe84f3dab7d0981dae4bc10 2023-11-18 00:55:04,943 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/9909993d75874a0996859c9dd27e20c2 2023-11-18 00:55:04,944 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ae1bdf79fe84f3dab7d0981dae4bc10 2023-11-18 00:55:04,945 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/fe0ce09e76cd45c0974cf6dba615de27 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/fe0ce09e76cd45c0974cf6dba615de27 2023-11-18 00:55:04,946 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9909993d75874a0996859c9dd27e20c2 2023-11-18 00:55:04,947 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/807e8ef37b5141268d15ae6495bedd58 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/807e8ef37b5141268d15ae6495bedd58 2023-11-18 00:55:04,949 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe0ce09e76cd45c0974cf6dba615de27 2023-11-18 00:55:04,949 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/fe0ce09e76cd45c0974cf6dba615de27, entries=3, sequenceid=24, filesize=5.0 K 2023-11-18 00:55:04,950 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/3ae1bdf79fe84f3dab7d0981dae4bc10 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/3ae1bdf79fe84f3dab7d0981dae4bc10 2023-11-18 00:55:04,951 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 807e8ef37b5141268d15ae6495bedd58 2023-11-18 00:55:04,951 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/807e8ef37b5141268d15ae6495bedd58, entries=3, sequenceid=24, filesize=5.0 K 2023-11-18 00:55:04,952 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/9909993d75874a0996859c9dd27e20c2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/9909993d75874a0996859c9dd27e20c2 2023-11-18 00:55:04,953 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ae1bdf79fe84f3dab7d0981dae4bc10 2023-11-18 00:55:04,953 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/3ae1bdf79fe84f3dab7d0981dae4bc10, entries=1, sequenceid=24, filesize=5.0 K 2023-11-18 00:55:04,954 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cfa25bcf33a8406213d9a872fe13b7d1 in 447ms, sequenceid=24, compaction requested=true 2023-11-18 00:55:04,954 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:04,954 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:04,954 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:04,955 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9909993d75874a0996859c9dd27e20c2 2023-11-18 00:55:04,955 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/9909993d75874a0996859c9dd27e20c2, entries=1, sequenceid=24, filesize=5.0 K 2023-11-18 00:55:04,956 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 442deadaba9fce82374166dd2c4e6d7a in 449ms, sequenceid=24, compaction requested=true 2023-11-18 00:55:04,956 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:04,956 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:04,956 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:05,324 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/3a9497c05ed54fdcb71f550d076d4776 2023-11-18 00:55:05,329 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a9497c05ed54fdcb71f550d076d4776 2023-11-18 00:55:05,743 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/52c59f6d4781401f87017f9ad30f216a 2023-11-18 00:55:05,746 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52c59f6d4781401f87017f9ad30f216a 2023-11-18 00:55:05,747 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/3a9497c05ed54fdcb71f550d076d4776 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/3a9497c05ed54fdcb71f550d076d4776 2023-11-18 00:55:05,750 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a9497c05ed54fdcb71f550d076d4776 2023-11-18 00:55:05,750 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/3a9497c05ed54fdcb71f550d076d4776, entries=3, sequenceid=24, filesize=5.0 K 2023-11-18 00:55:05,751 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/52c59f6d4781401f87017f9ad30f216a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/52c59f6d4781401f87017f9ad30f216a 2023-11-18 00:55:05,754 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52c59f6d4781401f87017f9ad30f216a 2023-11-18 00:55:05,754 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/52c59f6d4781401f87017f9ad30f216a, entries=1, sequenceid=24, filesize=5.0 K 2023-11-18 00:55:05,755 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7303eedc2c2e47c9b75c5b6fa37c67a7 in 1248ms, sequenceid=24, compaction requested=true 2023-11-18 00:55:05,755 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:05,755 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:05,755 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:05,755 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:05,755 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,755 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 00:55:05,755 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 00:55:05,757 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,757 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:05,757 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:05,758 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:05,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 00:55:05,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@709d2ca5[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:05,759 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 00:55:05,759 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:05,760 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:05,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:05,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:05,760 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 00:55:05,760 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 00:55:05,760 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:05,760 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,760 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:05,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 00:55:05,762 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:05,762 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 00:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:05,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:05,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 00:55:05,764 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 00:55:05,764 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:05,764 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:05,764 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 00:55:05,764 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:05,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:05,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:05,766 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:05,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:05,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:05,767 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,768 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 00:55:05,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:05,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:05,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:05,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 00:55:05,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:05,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:05,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:05,770 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:05,770 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 00:55:05,771 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:05,771 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:05,771 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:05,771 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:05,771 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 00:55:05,771 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 00:55:05,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:05,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:05,871 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:05,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:05,873 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:05,873 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 is initiating major compaction (all files) 2023-11-18 00:55:05,873 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:05,873 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:05,873 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 in testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:05,873 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/08e5ac76d4b74b2d979463e33a216ae6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/27088c31b03d43aeb9ef655978ddcaac, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/da04a313a3de40b0999c0913a74dcd53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/263a1dbd5a294a08b43db97afe0128ef, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/3a9497c05ed54fdcb71f550d076d4776] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp, totalSize=26.7 K 2023-11-18 00:55:05,874 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 08e5ac76d4b74b2d979463e33a216ae6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895097 2023-11-18 00:55:05,874 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 27088c31b03d43aeb9ef655978ddcaac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:05,875 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting da04a313a3de40b0999c0913a74dcd53, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:05,875 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 263a1dbd5a294a08b43db97afe0128ef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:05,875 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 3a9497c05ed54fdcb71f550d076d4776, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 00:55:05,890 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 7303eedc2c2e47c9b75c5b6fa37c67a7#family1#compaction#108 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:06,300 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311185fae274619224a298fb2610f642961fb_del 2023-11-18 00:55:06,300 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311185fae274619224a298fb2610f642961fb_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311185fae274619224a298fb2610f642961fb_del 2023-11-18 00:55:07,113 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69ac99a6841242d5bed48324699b14b3 2023-11-18 00:55:07,114 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/69ac99a6841242d5bed48324699b14b3 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/69ac99a6841242d5bed48324699b14b3 2023-11-18 00:55:07,118 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69ac99a6841242d5bed48324699b14b3 2023-11-18 00:55:07,119 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 of 7303eedc2c2e47c9b75c5b6fa37c67a7 into 69ac99a6841242d5bed48324699b14b3(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:07,119 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:07,119 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:07,119 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 7303eedc2c2e47c9b75c5b6fa37c67a7/family2 is initiating major compaction (all files) 2023-11-18 00:55:07,119 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:07,119 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:07,119 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 7303eedc2c2e47c9b75c5b6fa37c67a7/family2 in testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:07,119 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/7c8cc1644db0418abf429b716ab53965, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/a4913979410f4abfab4bd5115f84cc29, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/74df5584be5a4eb098ade8ac332af1c8, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/52c59f6d4781401f87017f9ad30f216a] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp, totalSize=25.4 K 2023-11-18 00:55:07,120 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting ed03bb6e4e5b4f818a6b2ab367fdf3f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895097 2023-11-18 00:55:07,120 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 7c8cc1644db0418abf429b716ab53965, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:07,120 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting a4913979410f4abfab4bd5115f84cc29, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:07,121 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 74df5584be5a4eb098ade8ac332af1c8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:07,121 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 52c59f6d4781401f87017f9ad30f216a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 00:55:07,137 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 7303eedc2c2e47c9b75c5b6fa37c67a7#family2#compaction#109 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:07,154 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118a78f02a900dc492da2cc767fb5ac385f_del 2023-11-18 00:55:07,154 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118a78f02a900dc492da2cc767fb5ac385f_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118a78f02a900dc492da2cc767fb5ac385f_del 2023-11-18 00:55:07,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/08e5ac76d4b74b2d979463e33a216ae6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/27088c31b03d43aeb9ef655978ddcaac, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/da04a313a3de40b0999c0913a74dcd53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/263a1dbd5a294a08b43db97afe0128ef, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/3a9497c05ed54fdcb71f550d076d4776] to archive 2023-11-18 00:55:07,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:07,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/08e5ac76d4b74b2d979463e33a216ae6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/08e5ac76d4b74b2d979463e33a216ae6 2023-11-18 00:55:07,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/27088c31b03d43aeb9ef655978ddcaac to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/27088c31b03d43aeb9ef655978ddcaac 2023-11-18 00:55:07,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/da04a313a3de40b0999c0913a74dcd53 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/da04a313a3de40b0999c0913a74dcd53 2023-11-18 00:55:07,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/263a1dbd5a294a08b43db97afe0128ef to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/263a1dbd5a294a08b43db97afe0128ef 2023-11-18 00:55:07,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/3a9497c05ed54fdcb71f550d076d4776 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/3a9497c05ed54fdcb71f550d076d4776 2023-11-18 00:55:07,968 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0662427ea3f8451f91341d56d7fc342c 2023-11-18 00:55:07,968 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/0662427ea3f8451f91341d56d7fc342c as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/0662427ea3f8451f91341d56d7fc342c 2023-11-18 00:55:07,973 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0662427ea3f8451f91341d56d7fc342c 2023-11-18 00:55:07,974 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7303eedc2c2e47c9b75c5b6fa37c67a7/family2 of 7303eedc2c2e47c9b75c5b6fa37c67a7 into 0662427ea3f8451f91341d56d7fc342c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:07,974 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:07,974 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:07,974 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 442deadaba9fce82374166dd2c4e6d7a/family1 is initiating major compaction (all files) 2023-11-18 00:55:07,974 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:07,974 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:07,974 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 442deadaba9fce82374166dd2c4e6d7a/family1 in testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:07,975 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/94c8b9ad46614e6d8796f2687ac8e3e7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/d7fa18d64950477f98a9b20d51b6ca8b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/813dda4be0644adb89b282d3239d7c5a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/5a29fca910e34e7da53083b89d144603, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/807e8ef37b5141268d15ae6495bedd58] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp, totalSize=26.7 K 2023-11-18 00:55:07,975 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 94c8b9ad46614e6d8796f2687ac8e3e7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895098 2023-11-18 00:55:07,975 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting d7fa18d64950477f98a9b20d51b6ca8b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:07,976 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 813dda4be0644adb89b282d3239d7c5a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:07,976 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 5a29fca910e34e7da53083b89d144603, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:07,977 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 807e8ef37b5141268d15ae6495bedd58, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 00:55:07,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/7c8cc1644db0418abf429b716ab53965, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/a4913979410f4abfab4bd5115f84cc29, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/74df5584be5a4eb098ade8ac332af1c8, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/52c59f6d4781401f87017f9ad30f216a] to archive 2023-11-18 00:55:07,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:07,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/ed03bb6e4e5b4f818a6b2ab367fdf3f0 2023-11-18 00:55:07,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/7c8cc1644db0418abf429b716ab53965 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/7c8cc1644db0418abf429b716ab53965 2023-11-18 00:55:07,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/a4913979410f4abfab4bd5115f84cc29 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/a4913979410f4abfab4bd5115f84cc29 2023-11-18 00:55:07,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/74df5584be5a4eb098ade8ac332af1c8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/74df5584be5a4eb098ade8ac332af1c8 2023-11-18 00:55:07,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/52c59f6d4781401f87017f9ad30f216a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/52c59f6d4781401f87017f9ad30f216a 2023-11-18 00:55:07,999 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 442deadaba9fce82374166dd2c4e6d7a#family1#compaction#110 average throughput is 0.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:08,412 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311184223a5e606b549a5a0cb219c3223d151_del 2023-11-18 00:55:08,412 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311184223a5e606b549a5a0cb219c3223d151_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311184223a5e606b549a5a0cb219c3223d151_del 2023-11-18 00:55:08,827 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ee726e5d6c54abcb13229c5d49f7e87 2023-11-18 00:55:08,833 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/7ee726e5d6c54abcb13229c5d49f7e87 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/7ee726e5d6c54abcb13229c5d49f7e87 2023-11-18 00:55:08,838 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ee726e5d6c54abcb13229c5d49f7e87 2023-11-18 00:55:08,839 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 442deadaba9fce82374166dd2c4e6d7a/family1 of 442deadaba9fce82374166dd2c4e6d7a into 7ee726e5d6c54abcb13229c5d49f7e87(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:08,839 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:08,839 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:08,839 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 442deadaba9fce82374166dd2c4e6d7a/family2 is initiating major compaction (all files) 2023-11-18 00:55:08,840 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:08,840 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:08,840 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 442deadaba9fce82374166dd2c4e6d7a/family2 in testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:08,840 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d567fe7d0edc4218a7a55e7950449345, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2f4d03df7c6f4811b775008bd7b5b56b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/82db48fc1ec844288c9e0f19f1139e40, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/1ddb43c04ff54d2a843b199ad0ec07e9, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/9909993d75874a0996859c9dd27e20c2] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp, totalSize=25.4 K 2023-11-18 00:55:08,840 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting d567fe7d0edc4218a7a55e7950449345, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895098 2023-11-18 00:55:08,841 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 2f4d03df7c6f4811b775008bd7b5b56b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:08,841 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 82db48fc1ec844288c9e0f19f1139e40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:08,842 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 1ddb43c04ff54d2a843b199ad0ec07e9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:08,842 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 9909993d75874a0996859c9dd27e20c2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 00:55:08,861 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 442deadaba9fce82374166dd2c4e6d7a#family2#compaction#111 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:08,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/94c8b9ad46614e6d8796f2687ac8e3e7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/d7fa18d64950477f98a9b20d51b6ca8b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/813dda4be0644adb89b282d3239d7c5a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/5a29fca910e34e7da53083b89d144603, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/807e8ef37b5141268d15ae6495bedd58] to archive 2023-11-18 00:55:08,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:08,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/94c8b9ad46614e6d8796f2687ac8e3e7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/94c8b9ad46614e6d8796f2687ac8e3e7 2023-11-18 00:55:08,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/d7fa18d64950477f98a9b20d51b6ca8b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/d7fa18d64950477f98a9b20d51b6ca8b 2023-11-18 00:55:08,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/813dda4be0644adb89b282d3239d7c5a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/813dda4be0644adb89b282d3239d7c5a 2023-11-18 00:55:08,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/5a29fca910e34e7da53083b89d144603 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/5a29fca910e34e7da53083b89d144603 2023-11-18 00:55:08,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/807e8ef37b5141268d15ae6495bedd58 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/807e8ef37b5141268d15ae6495bedd58 2023-11-18 00:55:09,270 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111882f83890fb554dcab567eab062836ddb_del 2023-11-18 00:55:09,270 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111882f83890fb554dcab567eab062836ddb_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111882f83890fb554dcab567eab062836ddb_del 2023-11-18 00:55:10,084 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d54c41b312804dc4856f4571ae0ee58b 2023-11-18 00:55:10,084 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/d54c41b312804dc4856f4571ae0ee58b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d54c41b312804dc4856f4571ae0ee58b 2023-11-18 00:55:10,088 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d54c41b312804dc4856f4571ae0ee58b 2023-11-18 00:55:10,089 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 442deadaba9fce82374166dd2c4e6d7a/family2 of 442deadaba9fce82374166dd2c4e6d7a into d54c41b312804dc4856f4571ae0ee58b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:10,089 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:10,089 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:10,089 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): cfa25bcf33a8406213d9a872fe13b7d1/family1 is initiating major compaction (all files) 2023-11-18 00:55:10,089 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:10,089 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:10,090 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of cfa25bcf33a8406213d9a872fe13b7d1/family1 in testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:10,090 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/96bbe44d8d9941d7a26822d1a731a53d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/01ca07db7a334b5da1cb7b7bbb71d185, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/5a8894ca4545419887a124e3a13168f5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ea672d23bb424cfba0b0e1abcc5f4bbb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/fe0ce09e76cd45c0974cf6dba615de27] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp, totalSize=26.7 K 2023-11-18 00:55:10,091 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 96bbe44d8d9941d7a26822d1a731a53d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895099 2023-11-18 00:55:10,091 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 01ca07db7a334b5da1cb7b7bbb71d185, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:10,091 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 5a8894ca4545419887a124e3a13168f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:10,091 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting ea672d23bb424cfba0b0e1abcc5f4bbb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:10,092 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting fe0ce09e76cd45c0974cf6dba615de27, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 00:55:10,102 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): cfa25bcf33a8406213d9a872fe13b7d1#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:10,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d567fe7d0edc4218a7a55e7950449345, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2f4d03df7c6f4811b775008bd7b5b56b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/82db48fc1ec844288c9e0f19f1139e40, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/1ddb43c04ff54d2a843b199ad0ec07e9, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/9909993d75874a0996859c9dd27e20c2] to archive 2023-11-18 00:55:10,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:10,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d567fe7d0edc4218a7a55e7950449345 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d567fe7d0edc4218a7a55e7950449345 2023-11-18 00:55:10,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2f4d03df7c6f4811b775008bd7b5b56b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2f4d03df7c6f4811b775008bd7b5b56b 2023-11-18 00:55:10,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/82db48fc1ec844288c9e0f19f1139e40 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/82db48fc1ec844288c9e0f19f1139e40 2023-11-18 00:55:10,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/1ddb43c04ff54d2a843b199ad0ec07e9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/1ddb43c04ff54d2a843b199ad0ec07e9 2023-11-18 00:55:10,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/9909993d75874a0996859c9dd27e20c2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/9909993d75874a0996859c9dd27e20c2 2023-11-18 00:55:10,512 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118c9f393e572d643459463dcdde90adb33_del 2023-11-18 00:55:10,512 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118c9f393e572d643459463dcdde90adb33_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118c9f393e572d643459463dcdde90adb33_del 2023-11-18 00:55:11,326 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab5755af2fe84d329eb66060c45cf368 2023-11-18 00:55:11,327 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/ab5755af2fe84d329eb66060c45cf368 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ab5755af2fe84d329eb66060c45cf368 2023-11-18 00:55:11,331 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab5755af2fe84d329eb66060c45cf368 2023-11-18 00:55:11,332 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cfa25bcf33a8406213d9a872fe13b7d1/family1 of cfa25bcf33a8406213d9a872fe13b7d1 into ab5755af2fe84d329eb66060c45cf368(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:11,333 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:11,333 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:11,333 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): cfa25bcf33a8406213d9a872fe13b7d1/family2 is initiating major compaction (all files) 2023-11-18 00:55:11,333 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:11,333 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:11,333 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of cfa25bcf33a8406213d9a872fe13b7d1/family2 in testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:11,333 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/bb828e9bf7274ca0881069b84580cb39, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/a2dbfbf01a384ad29818ea368842e94d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/86a1eacd04814518bf608cf9947b75b4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/4b184040f04c46308a3d217275349b26, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/3ae1bdf79fe84f3dab7d0981dae4bc10] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp, totalSize=25.4 K 2023-11-18 00:55:11,334 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting bb828e9bf7274ca0881069b84580cb39, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895099 2023-11-18 00:55:11,335 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting a2dbfbf01a384ad29818ea368842e94d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:11,335 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 86a1eacd04814518bf608cf9947b75b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:11,336 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 4b184040f04c46308a3d217275349b26, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:11,336 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 3ae1bdf79fe84f3dab7d0981dae4bc10, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 00:55:11,352 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): cfa25bcf33a8406213d9a872fe13b7d1#family2#compaction#113 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:11,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/96bbe44d8d9941d7a26822d1a731a53d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/01ca07db7a334b5da1cb7b7bbb71d185, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/5a8894ca4545419887a124e3a13168f5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ea672d23bb424cfba0b0e1abcc5f4bbb, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/fe0ce09e76cd45c0974cf6dba615de27] to archive 2023-11-18 00:55:11,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:11,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/96bbe44d8d9941d7a26822d1a731a53d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/96bbe44d8d9941d7a26822d1a731a53d 2023-11-18 00:55:11,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/01ca07db7a334b5da1cb7b7bbb71d185 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/01ca07db7a334b5da1cb7b7bbb71d185 2023-11-18 00:55:11,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/5a8894ca4545419887a124e3a13168f5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/5a8894ca4545419887a124e3a13168f5 2023-11-18 00:55:11,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ea672d23bb424cfba0b0e1abcc5f4bbb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ea672d23bb424cfba0b0e1abcc5f4bbb 2023-11-18 00:55:11,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/fe0ce09e76cd45c0974cf6dba615de27 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/fe0ce09e76cd45c0974cf6dba615de27 2023-11-18 00:55:11,764 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311182dcc3f76d7204939829dea924a3abd46_del 2023-11-18 00:55:11,764 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311182dcc3f76d7204939829dea924a3abd46_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182dcc3f76d7204939829dea924a3abd46_del 2023-11-18 00:55:12,578 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bb16dfb72334a3e81e44016aae962d8 2023-11-18 00:55:12,579 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/9bb16dfb72334a3e81e44016aae962d8 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/9bb16dfb72334a3e81e44016aae962d8 2023-11-18 00:55:12,583 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bb16dfb72334a3e81e44016aae962d8 2023-11-18 00:55:12,584 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cfa25bcf33a8406213d9a872fe13b7d1/family2 of cfa25bcf33a8406213d9a872fe13b7d1 into 9bb16dfb72334a3e81e44016aae962d8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:12,584 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:12,588 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:12,592 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:12,596 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:12,597 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:12,604 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 00:55:12,638 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-18 00:55:12,641 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311185fae274619224a298fb2610f642961fb_del 2023-11-18 00:55:12,645 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311184223a5e606b549a5a0cb219c3223d151_del 2023-11-18 00:55:12,648 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118c9f393e572d643459463dcdde90adb33_del 2023-11-18 00:55:12,648 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:12,649 DEBUG [Listener at localhost/41175] zookeeper.ReadOnlyZKClient(139): Connect 0x2ad6c499 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:55:12,655 DEBUG [Listener at localhost/41175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@336a325f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:55:12,655 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:12,655 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:12,655 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:12,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/bb828e9bf7274ca0881069b84580cb39, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/a2dbfbf01a384ad29818ea368842e94d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/86a1eacd04814518bf608cf9947b75b4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/4b184040f04c46308a3d217275349b26, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/3ae1bdf79fe84f3dab7d0981dae4bc10] to archive 2023-11-18 00:55:12,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:12,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/bb828e9bf7274ca0881069b84580cb39 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/bb828e9bf7274ca0881069b84580cb39 2023-11-18 00:55:12,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/a2dbfbf01a384ad29818ea368842e94d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/a2dbfbf01a384ad29818ea368842e94d 2023-11-18 00:55:12,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/86a1eacd04814518bf608cf9947b75b4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/86a1eacd04814518bf608cf9947b75b4 2023-11-18 00:55:12,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/4b184040f04c46308a3d217275349b26 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/4b184040f04c46308a3d217275349b26 2023-11-18 00:55:12,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/3ae1bdf79fe84f3dab7d0981dae4bc10 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/3ae1bdf79fe84f3dab7d0981dae4bc10 2023-11-18 00:55:13,152 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118e17fa6a75bd54a529c68e8d8aa77b4dd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e17fa6a75bd54a529c68e8d8aa77b4dd 2023-11-18 00:55:13,153 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:13,166 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:55:13,169 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:55:13,174 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:55:13,176 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:55:13,183 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/910cd2b8bed04e71a1fc33d4ce43b2c7 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-18 00:55:13,184 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/910cd2b8bed04e71a1fc33d4ce43b2c7}] 2023-11-18 00:55:13,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/910cd2b8bed04e71a1fc33d4ce43b2c7 for inclusion in 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 2023-11-18 00:55:13,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-18 00:55:13,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last=1 2023-11-18 00:55:13,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:13,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/910cd2b8bed04e71a1fc33d4ce43b2c7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__4mapo213gk9mau85in2dqsqopjraaluf8cdafpl75danfegg5iqabcgpsnpql9ua/family1/910cd2b8bed04e71a1fc33d4ce43b2c7 2023-11-18 00:55:13,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__4mapo213gk9mau85in2dqsqopjraaluf8cdafpl75danfegg5iqabcgpsnpql9ua/family1/910cd2b8bed04e71a1fc33d4ce43b2c7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/4e63dae1676f4661baeadd9805aae319_SeqId_29_ 2023-11-18 00:55:13,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__4mapo213gk9mau85in2dqsqopjraaluf8cdafpl75danfegg5iqabcgpsnpql9ua/family1/910cd2b8bed04e71a1fc33d4ce43b2c7 into 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/4e63dae1676f4661baeadd9805aae319_SeqId_29_ - updating store file list. 2023-11-18 00:55:13,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/4e63dae1676f4661baeadd9805aae319_SeqId_29_ into 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 2023-11-18 00:55:13,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__4mapo213gk9mau85in2dqsqopjraaluf8cdafpl75danfegg5iqabcgpsnpql9ua/family1/910cd2b8bed04e71a1fc33d4ce43b2c7 into 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/4e63dae1676f4661baeadd9805aae319_SeqId_29_) 2023-11-18 00:55:13,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__4mapo213gk9mau85in2dqsqopjraaluf8cdafpl75danfegg5iqabcgpsnpql9ua/family1/910cd2b8bed04e71a1fc33d4ce43b2c7 2023-11-18 00:55:13,197 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:13,197 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:13,198 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e 2023-11-18 00:55:13,199 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2 2023-11-18 00:55:13,200 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535 2023-11-18 00:55:13,201 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed 2023-11-18 00:55:13,201 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 00:55:13,201 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 00:55:13,202 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:13,556 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111872bb3f2d82e54d8a9c5b7923e0d8147c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111872bb3f2d82e54d8a9c5b7923e0d8147c 2023-11-18 00:55:13,556 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311189cb63c392ca74871a402b5dcce496cbc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311189cb63c392ca74871a402b5dcce496cbc 2023-11-18 00:55:13,557 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:13,557 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:13,598 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/fc556328c83447d288a31624dcd3de23 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-18 00:55:13,600 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/fc556328c83447d288a31624dcd3de23}] 2023-11-18 00:55:13,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/fc556328c83447d288a31624dcd3de23 for inclusion in cfa25bcf33a8406213d9a872fe13b7d1/family1 2023-11-18 00:55:13,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-18 00:55:13,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 00:55:13,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:13,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/fc556328c83447d288a31624dcd3de23 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__l0iokoc39gutgq93rk71bpkrnuaecie9cr5dkos1akt2g5kar87988tlijiiafkh/family1/fc556328c83447d288a31624dcd3de23 2023-11-18 00:55:13,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__l0iokoc39gutgq93rk71bpkrnuaecie9cr5dkos1akt2g5kar87988tlijiiafkh/family1/fc556328c83447d288a31624dcd3de23 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/53a8a529c85e482abd9dfff278a4803e_SeqId_29_ 2023-11-18 00:55:13,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__l0iokoc39gutgq93rk71bpkrnuaecie9cr5dkos1akt2g5kar87988tlijiiafkh/family1/fc556328c83447d288a31624dcd3de23 into cfa25bcf33a8406213d9a872fe13b7d1/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/53a8a529c85e482abd9dfff278a4803e_SeqId_29_ - updating store file list. 2023-11-18 00:55:13,610 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/9b3f334d807342baa6ca2b84b0f12dda first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-18 00:55:13,611 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/9b3f334d807342baa6ca2b84b0f12dda}] 2023-11-18 00:55:13,613 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/9b3f334d807342baa6ca2b84b0f12dda for inclusion in 442deadaba9fce82374166dd2c4e6d7a/family1 2023-11-18 00:55:13,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/53a8a529c85e482abd9dfff278a4803e_SeqId_29_ into cfa25bcf33a8406213d9a872fe13b7d1/family1 2023-11-18 00:55:13,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__l0iokoc39gutgq93rk71bpkrnuaecie9cr5dkos1akt2g5kar87988tlijiiafkh/family1/fc556328c83447d288a31624dcd3de23 into cfa25bcf33a8406213d9a872fe13b7d1/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/53a8a529c85e482abd9dfff278a4803e_SeqId_29_) 2023-11-18 00:55:13,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__l0iokoc39gutgq93rk71bpkrnuaecie9cr5dkos1akt2g5kar87988tlijiiafkh/family1/fc556328c83447d288a31624dcd3de23 2023-11-18 00:55:13,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-18 00:55:13,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-18 00:55:13,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:13,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/9b3f334d807342baa6ca2b84b0f12dda to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__fopcpokk2oninroavipnr12ekvvlsr5bjvd4l3acr56853mjfl5ruf46kth3c0lo/family1/9b3f334d807342baa6ca2b84b0f12dda 2023-11-18 00:55:13,620 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:13,621 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:13,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__fopcpokk2oninroavipnr12ekvvlsr5bjvd4l3acr56853mjfl5ruf46kth3c0lo/family1/9b3f334d807342baa6ca2b84b0f12dda as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/f31e6455f71f418f84a42b109c5b0828_SeqId_29_ 2023-11-18 00:55:13,622 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__fopcpokk2oninroavipnr12ekvvlsr5bjvd4l3acr56853mjfl5ruf46kth3c0lo/family1/9b3f334d807342baa6ca2b84b0f12dda into 442deadaba9fce82374166dd2c4e6d7a/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/f31e6455f71f418f84a42b109c5b0828_SeqId_29_ - updating store file list. 2023-11-18 00:55:13,622 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849 2023-11-18 00:55:13,624 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234 2023-11-18 00:55:13,626 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c 2023-11-18 00:55:13,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/f31e6455f71f418f84a42b109c5b0828_SeqId_29_ into 442deadaba9fce82374166dd2c4e6d7a/family1 2023-11-18 00:55:13,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__fopcpokk2oninroavipnr12ekvvlsr5bjvd4l3acr56853mjfl5ruf46kth3c0lo/family1/9b3f334d807342baa6ca2b84b0f12dda into 442deadaba9fce82374166dd2c4e6d7a/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/f31e6455f71f418f84a42b109c5b0828_SeqId_29_) 2023-11-18 00:55:13,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__fopcpokk2oninroavipnr12ekvvlsr5bjvd4l3acr56853mjfl5ruf46kth3c0lo/family1/9b3f334d807342baa6ca2b84b0f12dda 2023-11-18 00:55:13,627 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985 2023-11-18 00:55:13,627 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 00:55:13,627 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 00:55:13,628 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:13,628 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:13,629 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:13,630 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e 2023-11-18 00:55:13,632 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279 2023-11-18 00:55:13,633 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5 2023-11-18 00:55:13,634 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd 2023-11-18 00:55:13,634 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 00:55:13,634 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118' 2023-11-18 00:55:13,634 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:13,634 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:13,635 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:13,635 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311185fae274619224a298fb2610f642961fb_del] 2023-11-18 00:55:13,635 DEBUG [Listener at localhost/41175] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:13,639 DEBUG [Listener at localhost/41175] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311185fae274619224a298fb2610f642961fb_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311185fae274619224a298fb2610f642961fb_del 2023-11-18 00:55:13,639 INFO [Listener at localhost/41175] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-18 00:55:13,639 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311184223a5e606b549a5a0cb219c3223d151_del] 2023-11-18 00:55:13,640 DEBUG [Listener at localhost/41175] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:13,641 DEBUG [Listener at localhost/41175] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311184223a5e606b549a5a0cb219c3223d151_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311184223a5e606b549a5a0cb219c3223d151_del 2023-11-18 00:55:13,641 INFO [Listener at localhost/41175] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-18 00:55:13,641 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118c9f393e572d643459463dcdde90adb33_del] 2023-11-18 00:55:13,641 DEBUG [Listener at localhost/41175] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:13,643 DEBUG [Listener at localhost/41175] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118c9f393e572d643459463dcdde90adb33_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118c9f393e572d643459463dcdde90adb33_del 2023-11-18 00:55:13,644 INFO [Listener at localhost/41175] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-18 00:55:13,647 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:13,649 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:13,653 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:13,654 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:13,662 INFO [Listener at localhost/41175] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-18 00:55:13,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-18 00:55:13,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-18 00:55:13,666 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268913666"}]},"ts":"1700268913666"} 2023-11-18 00:55:13,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-18 00:55:13,668 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-18 00:55:13,669 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-18 00:55:13,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, UNASSIGN}] 2023-11-18 00:55:13,672 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, UNASSIGN 2023-11-18 00:55:13,672 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, UNASSIGN 2023-11-18 00:55:13,672 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, UNASSIGN 2023-11-18 00:55:13,673 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cfa25bcf33a8406213d9a872fe13b7d1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:13,673 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=7303eedc2c2e47c9b75c5b6fa37c67a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:13,673 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268913673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268913673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268913673"}]},"ts":"1700268913673"} 2023-11-18 00:55:13,673 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268913673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268913673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268913673"}]},"ts":"1700268913673"} 2023-11-18 00:55:13,673 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=442deadaba9fce82374166dd2c4e6d7a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:13,673 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268913673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268913673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268913673"}]},"ts":"1700268913673"} 2023-11-18 00:55:13,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure cfa25bcf33a8406213d9a872fe13b7d1, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:13,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 7303eedc2c2e47c9b75c5b6fa37c67a7, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:13,676 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 442deadaba9fce82374166dd2c4e6d7a, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:13,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-18 00:55:13,828 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:13,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:13,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7303eedc2c2e47c9b75c5b6fa37c67a7, disabling compactions & flushes 2023-11-18 00:55:13,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:13,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:13,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. after waiting 0 ms 2023-11-18 00:55:13,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:13,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-18 00:55:13,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:13,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:13,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:13,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:13,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 442deadaba9fce82374166dd2c4e6d7a, disabling compactions & flushes 2023-11-18 00:55:13,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:13,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:13,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. after waiting 0 ms 2023-11-18 00:55:13,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:13,836 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=7303eedc2c2e47c9b75c5b6fa37c67a7, regionState=CLOSED 2023-11-18 00:55:13,836 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268913836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268913836"}]},"ts":"1700268913836"} 2023-11-18 00:55:13,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-11-18 00:55:13,839 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 7303eedc2c2e47c9b75c5b6fa37c67a7, server=jenkins-hbase4.apache.org,46287,1700268799711 in 162 msec 2023-11-18 00:55:13,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, UNASSIGN in 169 msec 2023-11-18 00:55:13,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-18 00:55:13,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:13,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:13,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:13,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:13,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cfa25bcf33a8406213d9a872fe13b7d1, disabling compactions & flushes 2023-11-18 00:55:13,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:13,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:13,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=442deadaba9fce82374166dd2c4e6d7a, regionState=CLOSED 2023-11-18 00:55:13,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. after waiting 0 ms 2023-11-18 00:55:13,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:13,843 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268913842"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268913842"}]},"ts":"1700268913842"} 2023-11-18 00:55:13,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=90 2023-11-18 00:55:13,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 442deadaba9fce82374166dd2c4e6d7a, server=jenkins-hbase4.apache.org,46287,1700268799711 in 168 msec 2023-11-18 00:55:13,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, UNASSIGN in 175 msec 2023-11-18 00:55:13,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-18 00:55:13,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:13,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:13,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:13,855 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cfa25bcf33a8406213d9a872fe13b7d1, regionState=CLOSED 2023-11-18 00:55:13,855 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268913855"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268913855"}]},"ts":"1700268913855"} 2023-11-18 00:55:13,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=91 2023-11-18 00:55:13,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure cfa25bcf33a8406213d9a872fe13b7d1, server=jenkins-hbase4.apache.org,46287,1700268799711 in 182 msec 2023-11-18 00:55:13,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=88 2023-11-18 00:55:13,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, UNASSIGN in 188 msec 2023-11-18 00:55:13,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268913859"}]},"ts":"1700268913859"} 2023-11-18 00:55:13,861 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-18 00:55:13,863 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-18 00:55:13,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 201 msec 2023-11-18 00:55:13,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-18 00:55:13,970 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-18 00:55:13,981 INFO [Listener at localhost/41175] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1700268902311-1700268913981 2023-11-18 00:55:13,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 00:55:13,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700268913981 (current time:1700268913981). 2023-11-18 00:55:13,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-18 00:55:13,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] zookeeper.ReadOnlyZKClient(139): Connect 0x71d28a21 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:55:13,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4305ead1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:55:13,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:55:13,990 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:55:13,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71d28a21 to 127.0.0.1:58527 2023-11-18 00:55:13,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:55:13,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-18 00:55:13,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 00:55:13,993 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot, current working dir path: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700268902311-1700268913981 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-18 00:55:13,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 00:55:13,996 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 00:55:13,997 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700269513997 2023-11-18 00:55:13,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 00:55:13,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1700268902311-1700268913981 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-18 00:55:13,997 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:13,997 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-18 00:55:14,098 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:14,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:14,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 00:55:14,099 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-18 00:55:14,299 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:14,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:14,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 00:55:14,300 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-18 00:55:14,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-18 00:55:14,407 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-18 00:55:14,407 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-18 00:55:14,407 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-18 00:55:14,407 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-18 00:55:14,407 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-18 00:55:14,408 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-18 00:55:14,408 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-18 00:55:14,408 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-18 00:55:14,414 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/53a8a529c85e482abd9dfff278a4803e_SeqId_29_, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ab5755af2fe84d329eb66060c45cf368] hfiles 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/53a8a529c85e482abd9dfff278a4803e_SeqId_29_ 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ab5755af2fe84d329eb66060c45cf368 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/4e63dae1676f4661baeadd9805aae319_SeqId_29_, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/69ac99a6841242d5bed48324699b14b3] hfiles 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/4e63dae1676f4661baeadd9805aae319_SeqId_29_ 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/69ac99a6841242d5bed48324699b14b3 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/7ee726e5d6c54abcb13229c5d49f7e87, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/f31e6455f71f418f84a42b109c5b0828_SeqId_29_] hfiles 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311189cb63c392ca74871a402b5dcce496cbc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111872bb3f2d82e54d8a9c5b7923e0d8147c, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e17fa6a75bd54a529c68e8d8aa77b4dd] hfiles 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/7ee726e5d6c54abcb13229c5d49f7e87 2023-11-18 00:55:14,415 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311189cb63c392ca74871a402b5dcce496cbc 2023-11-18 00:55:14,416 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/f31e6455f71f418f84a42b109c5b0828_SeqId_29_ 2023-11-18 00:55:14,416 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/9bb16dfb72334a3e81e44016aae962d8] hfiles 2023-11-18 00:55:14,416 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111872bb3f2d82e54d8a9c5b7923e0d8147c 2023-11-18 00:55:14,416 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/9bb16dfb72334a3e81e44016aae962d8 2023-11-18 00:55:14,416 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e17fa6a75bd54a529c68e8d8aa77b4dd 2023-11-18 00:55:14,416 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/0662427ea3f8451f91341d56d7fc342c] hfiles 2023-11-18 00:55:14,416 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/0662427ea3f8451f91341d56d7fc342c 2023-11-18 00:55:14,417 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d54c41b312804dc4856f4571ae0ee58b] hfiles 2023-11-18 00:55:14,417 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d54c41b312804dc4856f4571ae0ee58b 2023-11-18 00:55:14,422 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311182f50e14cf86b44de8f5f02bf7022389c, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311183478007188b842c7866227ef7cf2d794, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111882f83890fb554dcab567eab062836ddb_del, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9a2998bd85b448ca8f91fe7d113c027, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118de38be1aa3a041bcb7794a51527201b0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182dcc3f76d7204939829dea924a3abd46_del, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311185a91b87d91974eceb6cc274ca0ae1465, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111869b44a03da76467b93015cf13b02ddba, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111886af3e1ea8954a04b9b9069f6b4f2276, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e57490cef922413c9000b658e147b028, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111881eb7e3698bd4cdf99b120c6e2e43bda, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118a78f02a900dc492da2cc767fb5ac385f_del, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118ac5ac06a69b24b3199984acb44637b39, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c18123d480c34ffaa43bf18f84f2008f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c73272c5b5454ae2bf9b5ebeec923e75] hfiles 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311182f50e14cf86b44de8f5f02bf7022389c 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311183478007188b842c7866227ef7cf2d794 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111882f83890fb554dcab567eab062836ddb_del 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9a2998bd85b448ca8f91fe7d113c027 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118de38be1aa3a041bcb7794a51527201b0 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182dcc3f76d7204939829dea924a3abd46_del 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311185a91b87d91974eceb6cc274ca0ae1465 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111869b44a03da76467b93015cf13b02ddba 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111886af3e1ea8954a04b9b9069f6b4f2276 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e57490cef922413c9000b658e147b028 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111881eb7e3698bd4cdf99b120c6e2e43bda 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118a78f02a900dc492da2cc767fb5ac385f_del 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118ac5ac06a69b24b3199984acb44637b39 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c18123d480c34ffaa43bf18f84f2008f 2023-11-18 00:55:14,423 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118c73272c5b5454ae2bf9b5ebeec923e75 2023-11-18 00:55:14,600 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:14,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:14,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 00:55:14,602 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-18 00:55:14,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-18 00:55:14,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1700268902311-1700268913981 2023-11-18 00:55:14,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700268902311-1700268913981 2023-11-18 00:55:14,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700268902311-1700268913981 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/hbase-failsafe-snaptb-1700268902311-1700268913981 2023-11-18 00:55:14,896 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1700268902311-1700268913981 of table testCompactionWithHFileLink completed 2023-11-18 00:55:14,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700268902311-1700268913981 2023-11-18 00:55:14,896 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700268902311-1700268913981 2023-11-18 00:55:14,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1700268902311-1700268913981 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700268913997Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1700268914404 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1700268902311-1700268913981 at 1700268914849 (+445 ms)Loading Region manifests for hbase-failsafe-snaptb-1700268902311-1700268913981 at 1700268914849Writing data manifest for hbase-failsafe-snaptb-1700268902311-1700268913981 at 1700268914853 (+4 ms)Verifying snapshot: hbase-failsafe-snaptb-1700268902311-1700268913981 at 1700268914859 (+6 ms)Snapshot hbase-failsafe-snaptb-1700268902311-1700268913981 of table testCompactionWithHFileLink completed at 1700268914896 (+37 ms) 2023-11-18 00:55:14,898 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 00:55:14,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 903 msec 2023-11-18 00:55:15,102 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 00:55:15,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 00:55:15,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1700268902311-1700268913981 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-18 00:55:15,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700268902311" table: "testCompactionWithHFileLink" creation_time: 1700268902320 type: FLUSH version: 2 ttl: 0 ) 2023-11-18 00:55:15,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1700268902311 as table=testCompactionWithHFileLink 2023-11-18 00:55:15,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-18 00:55:15,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-18 00:55:15,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-18 00:55:15,581 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-18 00:55:15,582 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-18 00:55:15,582 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-18 00:55:15,583 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 00:55:15,588 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1700268902311" table: "testCompactionWithHFileLink" creation_time: 1700268902320 type: FLUSH version: 2 ttl: 0 2023-11-18 00:55:15,589 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink 2023-11-18 00:55:15,593 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-18 00:55:15,599 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311189cb63c392ca74871a402b5dcce496cbc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311189cb63c392ca74871a402b5dcce496cbc 2023-11-18 00:55:15,601 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111872bb3f2d82e54d8a9c5b7923e0d8147c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111872bb3f2d82e54d8a9c5b7923e0d8147c 2023-11-18 00:55:15,602 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e17fa6a75bd54a529c68e8d8aa77b4dd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118e17fa6a75bd54a529c68e8d8aa77b4dd 2023-11-18 00:55:15,602 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,605 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279 of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,608 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5 of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,612 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,616 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849 of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,620 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234 of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,623 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,626 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985 of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,632 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,636 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2 of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,639 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535 of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,642 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed of snapshot=snaptb-1700268902311 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 00:55:15,646 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111882f83890fb554dcab567eab062836ddb_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111882f83890fb554dcab567eab062836ddb_del 2023-11-18 00:55:15,648 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182dcc3f76d7204939829dea924a3abd46_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182dcc3f76d7204939829dea924a3abd46_del 2023-11-18 00:55:15,649 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118a78f02a900dc492da2cc767fb5ac385f_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118a78f02a900dc492da2cc767fb5ac385f_del 2023-11-18 00:55:15,649 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:15,649 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:15,649 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:15,654 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/7ee726e5d6c54abcb13229c5d49f7e87 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/7ee726e5d6c54abcb13229c5d49f7e87 2023-11-18 00:55:15,654 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/53a8a529c85e482abd9dfff278a4803e_SeqId_29_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/53a8a529c85e482abd9dfff278a4803e_SeqId_29_ 2023-11-18 00:55:15,654 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/69ac99a6841242d5bed48324699b14b3 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/69ac99a6841242d5bed48324699b14b3 2023-11-18 00:55:15,656 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/f31e6455f71f418f84a42b109c5b0828_SeqId_29_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/f31e6455f71f418f84a42b109c5b0828_SeqId_29_ 2023-11-18 00:55:15,656 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 94c8b9ad46614e6d8796f2687ac8e3e7 of snapshot=snaptb-1700268902311 to region=442deadaba9fce82374166dd2c4e6d7a table=testCompactionWithHFileLink 2023-11-18 00:55:15,656 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ab5755af2fe84d329eb66060c45cf368 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/ab5755af2fe84d329eb66060c45cf368 2023-11-18 00:55:15,656 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 96bbe44d8d9941d7a26822d1a731a53d of snapshot=snaptb-1700268902311 to region=cfa25bcf33a8406213d9a872fe13b7d1 table=testCompactionWithHFileLink 2023-11-18 00:55:15,656 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/4e63dae1676f4661baeadd9805aae319_SeqId_29_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/4e63dae1676f4661baeadd9805aae319_SeqId_29_ 2023-11-18 00:55:15,656 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08e5ac76d4b74b2d979463e33a216ae6 of snapshot=snaptb-1700268902311 to region=7303eedc2c2e47c9b75c5b6fa37c67a7 table=testCompactionWithHFileLink 2023-11-18 00:55:15,669 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 01ca07db7a334b5da1cb7b7bbb71d185 of snapshot=snaptb-1700268902311 to region=cfa25bcf33a8406213d9a872fe13b7d1 table=testCompactionWithHFileLink 2023-11-18 00:55:15,669 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 27088c31b03d43aeb9ef655978ddcaac of snapshot=snaptb-1700268902311 to region=7303eedc2c2e47c9b75c5b6fa37c67a7 table=testCompactionWithHFileLink 2023-11-18 00:55:15,671 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d7fa18d64950477f98a9b20d51b6ca8b of snapshot=snaptb-1700268902311 to region=442deadaba9fce82374166dd2c4e6d7a table=testCompactionWithHFileLink 2023-11-18 00:55:15,677 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5a8894ca4545419887a124e3a13168f5 of snapshot=snaptb-1700268902311 to region=cfa25bcf33a8406213d9a872fe13b7d1 table=testCompactionWithHFileLink 2023-11-18 00:55:15,679 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink da04a313a3de40b0999c0913a74dcd53 of snapshot=snaptb-1700268902311 to region=7303eedc2c2e47c9b75c5b6fa37c67a7 table=testCompactionWithHFileLink 2023-11-18 00:55:15,680 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 813dda4be0644adb89b282d3239d7c5a of snapshot=snaptb-1700268902311 to region=442deadaba9fce82374166dd2c4e6d7a table=testCompactionWithHFileLink 2023-11-18 00:55:15,687 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ea672d23bb424cfba0b0e1abcc5f4bbb of snapshot=snaptb-1700268902311 to region=cfa25bcf33a8406213d9a872fe13b7d1 table=testCompactionWithHFileLink 2023-11-18 00:55:15,693 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 263a1dbd5a294a08b43db97afe0128ef of snapshot=snaptb-1700268902311 to region=7303eedc2c2e47c9b75c5b6fa37c67a7 table=testCompactionWithHFileLink 2023-11-18 00:55:15,693 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5a29fca910e34e7da53083b89d144603 of snapshot=snaptb-1700268902311 to region=442deadaba9fce82374166dd2c4e6d7a table=testCompactionWithHFileLink 2023-11-18 00:55:15,705 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/9bb16dfb72334a3e81e44016aae962d8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/9bb16dfb72334a3e81e44016aae962d8 2023-11-18 00:55:15,705 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bb828e9bf7274ca0881069b84580cb39 of snapshot=snaptb-1700268902311 to region=cfa25bcf33a8406213d9a872fe13b7d1 table=testCompactionWithHFileLink 2023-11-18 00:55:15,708 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/0662427ea3f8451f91341d56d7fc342c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/0662427ea3f8451f91341d56d7fc342c 2023-11-18 00:55:15,708 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ed03bb6e4e5b4f818a6b2ab367fdf3f0 of snapshot=snaptb-1700268902311 to region=7303eedc2c2e47c9b75c5b6fa37c67a7 table=testCompactionWithHFileLink 2023-11-18 00:55:15,710 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d54c41b312804dc4856f4571ae0ee58b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/d54c41b312804dc4856f4571ae0ee58b 2023-11-18 00:55:15,710 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d567fe7d0edc4218a7a55e7950449345 of snapshot=snaptb-1700268902311 to region=442deadaba9fce82374166dd2c4e6d7a table=testCompactionWithHFileLink 2023-11-18 00:55:15,710 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a2dbfbf01a384ad29818ea368842e94d of snapshot=snaptb-1700268902311 to region=cfa25bcf33a8406213d9a872fe13b7d1 table=testCompactionWithHFileLink 2023-11-18 00:55:15,717 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7c8cc1644db0418abf429b716ab53965 of snapshot=snaptb-1700268902311 to region=7303eedc2c2e47c9b75c5b6fa37c67a7 table=testCompactionWithHFileLink 2023-11-18 00:55:15,718 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2f4d03df7c6f4811b775008bd7b5b56b of snapshot=snaptb-1700268902311 to region=442deadaba9fce82374166dd2c4e6d7a table=testCompactionWithHFileLink 2023-11-18 00:55:15,719 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 86a1eacd04814518bf608cf9947b75b4 of snapshot=snaptb-1700268902311 to region=cfa25bcf33a8406213d9a872fe13b7d1 table=testCompactionWithHFileLink 2023-11-18 00:55:15,721 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a4913979410f4abfab4bd5115f84cc29 of snapshot=snaptb-1700268902311 to region=7303eedc2c2e47c9b75c5b6fa37c67a7 table=testCompactionWithHFileLink 2023-11-18 00:55:15,726 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 82db48fc1ec844288c9e0f19f1139e40 of snapshot=snaptb-1700268902311 to region=442deadaba9fce82374166dd2c4e6d7a table=testCompactionWithHFileLink 2023-11-18 00:55:15,727 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 74df5584be5a4eb098ade8ac332af1c8 of snapshot=snaptb-1700268902311 to region=7303eedc2c2e47c9b75c5b6fa37c67a7 table=testCompactionWithHFileLink 2023-11-18 00:55:15,727 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4b184040f04c46308a3d217275349b26 of snapshot=snaptb-1700268902311 to region=cfa25bcf33a8406213d9a872fe13b7d1 table=testCompactionWithHFileLink 2023-11-18 00:55:15,731 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1ddb43c04ff54d2a843b199ad0ec07e9 of snapshot=snaptb-1700268902311 to region=442deadaba9fce82374166dd2c4e6d7a table=testCompactionWithHFileLink 2023-11-18 00:55:15,735 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1700268902311" table: "testCompactionWithHFileLink" creation_time: 1700268902320 type: FLUSH version: 2 ttl: 0 2023-11-18 00:55:15,736 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700268915736"}]},"ts":"9223372036854775807"} 2023-11-18 00:55:15,736 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700268915736"}]},"ts":"9223372036854775807"} 2023-11-18 00:55:15,736 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700268915736"}]},"ts":"9223372036854775807"} 2023-11-18 00:55:15,738 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-18 00:55:15,738 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 442deadaba9fce82374166dd2c4e6d7a, NAME => 'testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 7303eedc2c2e47c9b75c5b6fa37c67a7, NAME => 'testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cfa25bcf33a8406213d9a872fe13b7d1, NAME => 'testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.', STARTKEY => '2', ENDKEY => ''}] 2023-11-18 00:55:15,738 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268915737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268915737"}]},"ts":"1700268915737"} 2023-11-18 00:55:15,738 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268915737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268915737"}]},"ts":"1700268915737"} 2023-11-18 00:55:15,738 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268915737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268915737"}]},"ts":"1700268915737"} 2023-11-18 00:55:15,739 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 00:55:15,739 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-18 00:55:15,739 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 442deadaba9fce82374166dd2c4e6d7a, NAME => 'testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 7303eedc2c2e47c9b75c5b6fa37c67a7, NAME => 'testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cfa25bcf33a8406213d9a872fe13b7d1, NAME => 'testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.', STARTKEY => '2', ENDKEY => ''}] 2023-11-18 00:55:15,740 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1700268902311 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-18 00:55:15,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700268902311" table: "testCompactionWithHFileLink" creation_time: 1700268902320 type: FLUSH version: 2 ttl: 0 ) in 582 msec 2023-11-18 00:55:15,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-18 00:55:15,777 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-18 00:55:15,777 INFO [Listener at localhost/41175] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1700268902311-1700268913981 2023-11-18 00:55:15,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1700268902311-1700268913981" 2023-11-18 00:55:15,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1700268902311-1700268913981 2023-11-18 00:55:15,786 INFO [Listener at localhost/41175] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-18 00:55:15,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-18 00:55:15,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-18 00:55:15,801 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-18 00:55:15,802 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268915801"}]},"ts":"1700268915801"} 2023-11-18 00:55:15,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 00:55:15,803 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-18 00:55:15,806 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-18 00:55:15,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, ASSIGN}] 2023-11-18 00:55:15,808 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, ASSIGN 2023-11-18 00:55:15,808 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, ASSIGN 2023-11-18 00:55:15,808 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, ASSIGN 2023-11-18 00:55:15,809 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-18 00:55:15,809 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-18 00:55:15,809 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-18 00:55:15,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 00:55:15,961 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cfa25bcf33a8406213d9a872fe13b7d1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:15,961 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=442deadaba9fce82374166dd2c4e6d7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:15,961 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=7303eedc2c2e47c9b75c5b6fa37c67a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:15,961 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268915961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268915961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268915961"}]},"ts":"1700268915961"} 2023-11-18 00:55:15,961 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268915961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268915961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268915961"}]},"ts":"1700268915961"} 2023-11-18 00:55:15,961 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268915961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268915961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268915961"}]},"ts":"1700268915961"} 2023-11-18 00:55:15,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 442deadaba9fce82374166dd2c4e6d7a, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:15,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure cfa25bcf33a8406213d9a872fe13b7d1, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:15,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 7303eedc2c2e47c9b75c5b6fa37c67a7, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:16,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 00:55:16,115 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:16,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:16,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 442deadaba9fce82374166dd2c4e6d7a, NAME => 'testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 00:55:16,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:16,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:16,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:16,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:16,122 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:16,122 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1 2023-11-18 00:55:16,123 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1 2023-11-18 00:55:16,123 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 442deadaba9fce82374166dd2c4e6d7a columnFamilyName family1 2023-11-18 00:55:16,133 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-5a29fca910e34e7da53083b89d144603 2023-11-18 00:55:16,139 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-813dda4be0644adb89b282d3239d7c5a 2023-11-18 00:55:16,144 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-94c8b9ad46614e6d8796f2687ac8e3e7 2023-11-18 00:55:16,149 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d7fa18d64950477f98a9b20d51b6ca8b 2023-11-18 00:55:16,150 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(310): Store=442deadaba9fce82374166dd2c4e6d7a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:16,150 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:16,151 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2 2023-11-18 00:55:16,151 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2 2023-11-18 00:55:16,151 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 442deadaba9fce82374166dd2c4e6d7a columnFamilyName family2 2023-11-18 00:55:16,168 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-1ddb43c04ff54d2a843b199ad0ec07e9 2023-11-18 00:55:16,176 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-2f4d03df7c6f4811b775008bd7b5b56b 2023-11-18 00:55:16,182 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-82db48fc1ec844288c9e0f19f1139e40 2023-11-18 00:55:16,187 DEBUG [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d567fe7d0edc4218a7a55e7950449345 2023-11-18 00:55:16,188 INFO [StoreOpener-442deadaba9fce82374166dd2c4e6d7a-1] regionserver.HStore(310): Store=442deadaba9fce82374166dd2c4e6d7a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:16,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:16,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:16,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:16,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:55:16,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 442deadaba9fce82374166dd2c4e6d7a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59743148, jitterRate=-0.10975772142410278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:16,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:16,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a., pid=101, masterSystemTime=1700268916115 2023-11-18 00:55:16,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:16,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:16,195 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 00:55:16,195 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 00:55:16,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:16,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:16,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:16,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cfa25bcf33a8406213d9a872fe13b7d1, NAME => 'testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 00:55:16,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:16,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:16,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:16,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:16,198 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=442deadaba9fce82374166dd2c4e6d7a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:16,199 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268916198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268916198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268916198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268916198"}]},"ts":"1700268916198"} 2023-11-18 00:55:16,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-11-18 00:55:16,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 442deadaba9fce82374166dd2c4e6d7a, server=jenkins-hbase4.apache.org,46287,1700268799711 in 237 msec 2023-11-18 00:55:16,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=442deadaba9fce82374166dd2c4e6d7a, ASSIGN in 396 msec 2023-11-18 00:55:16,204 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 00:55:16,205 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1912): 442deadaba9fce82374166dd2c4e6d7a/family2 is initiating minor compaction (all files) 2023-11-18 00:55:16,205 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 442deadaba9fce82374166dd2c4e6d7a/family2 in testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:16,205 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d567fe7d0edc4218a7a55e7950449345, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-2f4d03df7c6f4811b775008bd7b5b56b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-82db48fc1ec844288c9e0f19f1139e40, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-1ddb43c04ff54d2a843b199ad0ec07e9] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp, totalSize=20.4 K 2023-11-18 00:55:16,205 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:16,205 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 00:55:16,205 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1912): 442deadaba9fce82374166dd2c4e6d7a/family1 is initiating minor compaction (all files) 2023-11-18 00:55:16,206 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 442deadaba9fce82374166dd2c4e6d7a/family1 in testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:55:16,206 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-94c8b9ad46614e6d8796f2687ac8e3e7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d7fa18d64950477f98a9b20d51b6ca8b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-813dda4be0644adb89b282d3239d7c5a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-5a29fca910e34e7da53083b89d144603] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp, totalSize=21.6 K 2023-11-18 00:55:16,206 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-94c8b9ad46614e6d8796f2687ac8e3e7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895098 2023-11-18 00:55:16,206 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d567fe7d0edc4218a7a55e7950449345, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895098 2023-11-18 00:55:16,207 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1 2023-11-18 00:55:16,207 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1 2023-11-18 00:55:16,207 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-2f4d03df7c6f4811b775008bd7b5b56b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:16,207 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d7fa18d64950477f98a9b20d51b6ca8b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:16,207 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfa25bcf33a8406213d9a872fe13b7d1 columnFamilyName family1 2023-11-18 00:55:16,208 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-82db48fc1ec844288c9e0f19f1139e40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:16,209 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-813dda4be0644adb89b282d3239d7c5a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:16,209 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-1ddb43c04ff54d2a843b199ad0ec07e9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:16,210 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-5a29fca910e34e7da53083b89d144603, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:16,233 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-01ca07db7a334b5da1cb7b7bbb71d185 2023-11-18 00:55:16,243 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-5a8894ca4545419887a124e3a13168f5 2023-11-18 00:55:16,255 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-96bbe44d8d9941d7a26822d1a731a53d 2023-11-18 00:55:16,261 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] throttle.PressureAwareThroughputController(145): 442deadaba9fce82374166dd2c4e6d7a#family2#compaction#114 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:16,265 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 442deadaba9fce82374166dd2c4e6d7a#family1#compaction#115 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:16,273 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-ea672d23bb424cfba0b0e1abcc5f4bbb 2023-11-18 00:55:16,277 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(310): Store=cfa25bcf33a8406213d9a872fe13b7d1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:16,277 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:16,278 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2 2023-11-18 00:55:16,278 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2 2023-11-18 00:55:16,279 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfa25bcf33a8406213d9a872fe13b7d1 columnFamilyName family2 2023-11-18 00:55:16,296 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-4b184040f04c46308a3d217275349b26 2023-11-18 00:55:16,310 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family1/2d82d931014343ae85462731d08dd69d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/2d82d931014343ae85462731d08dd69d 2023-11-18 00:55:16,312 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-86a1eacd04814518bf608cf9947b75b4 2023-11-18 00:55:16,316 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-18 00:55:16,317 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 442deadaba9fce82374166dd2c4e6d7a/family1 of 442deadaba9fce82374166dd2c4e6d7a into 2d82d931014343ae85462731d08dd69d(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:16,317 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:16,317 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a., storeName=442deadaba9fce82374166dd2c4e6d7a/family1, priority=12, startTime=1700268916195; duration=0sec 2023-11-18 00:55:16,317 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:16,321 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-a2dbfbf01a384ad29818ea368842e94d 2023-11-18 00:55:16,326 DEBUG [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-bb828e9bf7274ca0881069b84580cb39 2023-11-18 00:55:16,326 INFO [StoreOpener-cfa25bcf33a8406213d9a872fe13b7d1-1] regionserver.HStore(310): Store=cfa25bcf33a8406213d9a872fe13b7d1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:16,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:16,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:16,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:16,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:55:16,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cfa25bcf33a8406213d9a872fe13b7d1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72374247, jitterRate=0.07846032083034515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:16,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:16,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1., pid=102, masterSystemTime=1700268916115 2023-11-18 00:55:16,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:16,334 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 00:55:16,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-18 00:55:16,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:16,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:16,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:16,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7303eedc2c2e47c9b75c5b6fa37c67a7, NAME => 'testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 00:55:16,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:16,336 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cfa25bcf33a8406213d9a872fe13b7d1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:16,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:16,336 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268916336"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268916336"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268916336"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268916336"}]},"ts":"1700268916336"} 2023-11-18 00:55:16,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-11-18 00:55:16,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure cfa25bcf33a8406213d9a872fe13b7d1, server=jenkins-hbase4.apache.org,46287,1700268799711 in 374 msec 2023-11-18 00:55:16,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:16,339 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 00:55:16,340 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1912): cfa25bcf33a8406213d9a872fe13b7d1/family1 is initiating minor compaction (all files) 2023-11-18 00:55:16,340 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cfa25bcf33a8406213d9a872fe13b7d1/family1 in testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:16,340 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-96bbe44d8d9941d7a26822d1a731a53d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-01ca07db7a334b5da1cb7b7bbb71d185, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-5a8894ca4545419887a124e3a13168f5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-ea672d23bb424cfba0b0e1abcc5f4bbb] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp, totalSize=21.6 K 2023-11-18 00:55:16,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:16,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=cfa25bcf33a8406213d9a872fe13b7d1, ASSIGN in 533 msec 2023-11-18 00:55:16,341 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-96bbe44d8d9941d7a26822d1a731a53d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895099 2023-11-18 00:55:16,342 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-01ca07db7a334b5da1cb7b7bbb71d185, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:16,342 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:16,342 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-5a8894ca4545419887a124e3a13168f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:16,343 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1 2023-11-18 00:55:16,343 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1 2023-11-18 00:55:16,343 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-ea672d23bb424cfba0b0e1abcc5f4bbb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:16,343 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7303eedc2c2e47c9b75c5b6fa37c67a7 columnFamilyName family1 2023-11-18 00:55:16,373 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-08e5ac76d4b74b2d979463e33a216ae6 2023-11-18 00:55:16,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-94c8b9ad46614e6d8796f2687ac8e3e7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d7fa18d64950477f98a9b20d51b6ca8b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-813dda4be0644adb89b282d3239d7c5a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-5a29fca910e34e7da53083b89d144603] to archive 2023-11-18 00:55:16,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:16,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-94c8b9ad46614e6d8796f2687ac8e3e7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-94c8b9ad46614e6d8796f2687ac8e3e7 2023-11-18 00:55:16,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d7fa18d64950477f98a9b20d51b6ca8b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d7fa18d64950477f98a9b20d51b6ca8b 2023-11-18 00:55:16,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-813dda4be0644adb89b282d3239d7c5a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-813dda4be0644adb89b282d3239d7c5a 2023-11-18 00:55:16,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-5a29fca910e34e7da53083b89d144603 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-5a29fca910e34e7da53083b89d144603 2023-11-18 00:55:16,391 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-263a1dbd5a294a08b43db97afe0128ef 2023-11-18 00:55:16,396 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-27088c31b03d43aeb9ef655978ddcaac 2023-11-18 00:55:16,402 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-da04a313a3de40b0999c0913a74dcd53 2023-11-18 00:55:16,405 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(310): Store=7303eedc2c2e47c9b75c5b6fa37c67a7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:16,405 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:16,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 00:55:16,406 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2 2023-11-18 00:55:16,406 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2 2023-11-18 00:55:16,407 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7303eedc2c2e47c9b75c5b6fa37c67a7 columnFamilyName family2 2023-11-18 00:55:16,412 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): cfa25bcf33a8406213d9a872fe13b7d1#family1#compaction#116 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:16,429 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-74df5584be5a4eb098ade8ac332af1c8 2023-11-18 00:55:16,436 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-7c8cc1644db0418abf429b716ab53965 2023-11-18 00:55:16,446 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-a4913979410f4abfab4bd5115f84cc29 2023-11-18 00:55:16,454 DEBUG [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(539): loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-ed03bb6e4e5b4f818a6b2ab367fdf3f0 2023-11-18 00:55:16,454 INFO [StoreOpener-7303eedc2c2e47c9b75c5b6fa37c67a7-1] regionserver.HStore(310): Store=7303eedc2c2e47c9b75c5b6fa37c67a7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:16,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:16,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:16,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:16,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:55:16,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7303eedc2c2e47c9b75c5b6fa37c67a7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71189984, jitterRate=0.06081342697143555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:16,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:16,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7., pid=103, masterSystemTime=1700268916115 2023-11-18 00:55:16,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-18 00:55:16,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-18 00:55:16,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:16,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:16,463 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=7303eedc2c2e47c9b75c5b6fa37c67a7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:16,464 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700268916463"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268916463"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268916463"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268916463"}]},"ts":"1700268916463"} 2023-11-18 00:55:16,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=98 2023-11-18 00:55:16,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 7303eedc2c2e47c9b75c5b6fa37c67a7, server=jenkins-hbase4.apache.org,46287,1700268799711 in 501 msec 2023-11-18 00:55:16,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-11-18 00:55:16,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7303eedc2c2e47c9b75c5b6fa37c67a7, ASSIGN in 661 msec 2023-11-18 00:55:16,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268916469"}]},"ts":"1700268916469"} 2023-11-18 00:55:16,470 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-18 00:55:16,473 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-18 00:55:16,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 682 msec 2023-11-18 00:55:16,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 00:55:16,907 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-18 00:55:16,920 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:16,929 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:16,937 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:16,938 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:16,945 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 00:55:16,960 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-18 00:55:16,960 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:16,961 DEBUG [Listener at localhost/41175] zookeeper.ReadOnlyZKClient(139): Connect 0x66f0040a to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:55:16,966 DEBUG [Listener at localhost/41175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10f06ef9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:55:16,967 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:16,967 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:16,967 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:17,073 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118ce0967b09b8542fb8281050d213528da to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118ce0967b09b8542fb8281050d213528da 2023-11-18 00:55:17,074 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:17,075 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118278238baea574b15b2f7e680ea66aaa0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118278238baea574b15b2f7e680ea66aaa0 2023-11-18 00:55:17,076 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:17,094 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:55:17,102 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/.tmp/family2/2fea746f6e8a4784b173bf79b467dd7e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/2fea746f6e8a4784b173bf79b467dd7e 2023-11-18 00:55:17,102 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:55:17,112 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 442deadaba9fce82374166dd2c4e6d7a/family2 of 442deadaba9fce82374166dd2c4e6d7a into 2fea746f6e8a4784b173bf79b467dd7e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:17,113 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:17,113 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a., storeName=442deadaba9fce82374166dd2c4e6d7a/family2, priority=12, startTime=1700268916195; duration=0sec 2023-11-18 00:55:17,113 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-18 00:55:17,113 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 00:55:17,119 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 00:55:17,119 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1912): cfa25bcf33a8406213d9a872fe13b7d1/family2 is initiating minor compaction (all files) 2023-11-18 00:55:17,119 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:55:17,119 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegion(2259): Starting compaction of cfa25bcf33a8406213d9a872fe13b7d1/family2 in testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:55:17,120 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-bb828e9bf7274ca0881069b84580cb39, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-a2dbfbf01a384ad29818ea368842e94d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-86a1eacd04814518bf608cf9947b75b4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-4b184040f04c46308a3d217275349b26] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp, totalSize=20.4 K 2023-11-18 00:55:17,120 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-bb828e9bf7274ca0881069b84580cb39, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895099 2023-11-18 00:55:17,121 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-a2dbfbf01a384ad29818ea368842e94d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:17,122 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-86a1eacd04814518bf608cf9947b75b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:17,122 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-4b184040f04c46308a3d217275349b26, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:17,126 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:55:17,154 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/ffdb6dda2c2a487f8e855b77e55602a7 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-18 00:55:17,158 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/ffdb6dda2c2a487f8e855b77e55602a7}] 2023-11-18 00:55:17,158 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] throttle.PressureAwareThroughputController(145): cfa25bcf33a8406213d9a872fe13b7d1#family2#compaction#117 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:17,163 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/37369a7121ec4561840597353d10521d first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-18 00:55:17,164 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/37369a7121ec4561840597353d10521d}] 2023-11-18 00:55:17,165 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/ffdb6dda2c2a487f8e855b77e55602a7 for inclusion in cfa25bcf33a8406213d9a872fe13b7d1/family1 2023-11-18 00:55:17,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/37369a7121ec4561840597353d10521d for inclusion in 442deadaba9fce82374166dd2c4e6d7a/family1 2023-11-18 00:55:17,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-18 00:55:17,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 00:55:17,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:17,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/ffdb6dda2c2a487f8e855b77e55602a7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__ncfa6made6n41bf5874rcrh58mlscqe04p8j36kljlar90kkieinnvb192i19jsg/family1/ffdb6dda2c2a487f8e855b77e55602a7 2023-11-18 00:55:17,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-18 00:55:17,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__ncfa6made6n41bf5874rcrh58mlscqe04p8j36kljlar90kkieinnvb192i19jsg/family1/ffdb6dda2c2a487f8e855b77e55602a7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/cd7a8b33be424ea78bc5efbe50b00162_SeqId_34_ 2023-11-18 00:55:17,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-18 00:55:17,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:55:17,175 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__ncfa6made6n41bf5874rcrh58mlscqe04p8j36kljlar90kkieinnvb192i19jsg/family1/ffdb6dda2c2a487f8e855b77e55602a7 into cfa25bcf33a8406213d9a872fe13b7d1/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/cd7a8b33be424ea78bc5efbe50b00162_SeqId_34_ - updating store file list. 2023-11-18 00:55:17,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/37369a7121ec4561840597353d10521d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__1cbuenau7oenibm4kme6ekbe7fh6psgh9i0uos2mruuq5og49rn9ldh5jvj9puao/family1/37369a7121ec4561840597353d10521d 2023-11-18 00:55:17,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d567fe7d0edc4218a7a55e7950449345, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-2f4d03df7c6f4811b775008bd7b5b56b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-82db48fc1ec844288c9e0f19f1139e40, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-1ddb43c04ff54d2a843b199ad0ec07e9] to archive 2023-11-18 00:55:17,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:17,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/cd7a8b33be424ea78bc5efbe50b00162_SeqId_34_ into cfa25bcf33a8406213d9a872fe13b7d1/family1 2023-11-18 00:55:17,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__ncfa6made6n41bf5874rcrh58mlscqe04p8j36kljlar90kkieinnvb192i19jsg/family1/ffdb6dda2c2a487f8e855b77e55602a7 into cfa25bcf33a8406213d9a872fe13b7d1/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/cd7a8b33be424ea78bc5efbe50b00162_SeqId_34_) 2023-11-18 00:55:17,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__1cbuenau7oenibm4kme6ekbe7fh6psgh9i0uos2mruuq5og49rn9ldh5jvj9puao/family1/37369a7121ec4561840597353d10521d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/0f9b60d1e7ad475f84141b126fb0e8b3_SeqId_36_ 2023-11-18 00:55:17,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d567fe7d0edc4218a7a55e7950449345 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-d567fe7d0edc4218a7a55e7950449345 2023-11-18 00:55:17,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__ncfa6made6n41bf5874rcrh58mlscqe04p8j36kljlar90kkieinnvb192i19jsg/family1/ffdb6dda2c2a487f8e855b77e55602a7 2023-11-18 00:55:17,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__1cbuenau7oenibm4kme6ekbe7fh6psgh9i0uos2mruuq5og49rn9ldh5jvj9puao/family1/37369a7121ec4561840597353d10521d into 442deadaba9fce82374166dd2c4e6d7a/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/0f9b60d1e7ad475f84141b126fb0e8b3_SeqId_36_ - updating store file list. 2023-11-18 00:55:17,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-2f4d03df7c6f4811b775008bd7b5b56b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-2f4d03df7c6f4811b775008bd7b5b56b 2023-11-18 00:55:17,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-82db48fc1ec844288c9e0f19f1139e40 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-82db48fc1ec844288c9e0f19f1139e40 2023-11-18 00:55:17,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/0f9b60d1e7ad475f84141b126fb0e8b3_SeqId_36_ into 442deadaba9fce82374166dd2c4e6d7a/family1 2023-11-18 00:55:17,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__1cbuenau7oenibm4kme6ekbe7fh6psgh9i0uos2mruuq5og49rn9ldh5jvj9puao/family1/37369a7121ec4561840597353d10521d into 442deadaba9fce82374166dd2c4e6d7a/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family1/0f9b60d1e7ad475f84141b126fb0e8b3_SeqId_36_) 2023-11-18 00:55:17,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__1cbuenau7oenibm4kme6ekbe7fh6psgh9i0uos2mruuq5og49rn9ldh5jvj9puao/family1/37369a7121ec4561840597353d10521d 2023-11-18 00:55:17,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-1ddb43c04ff54d2a843b199ad0ec07e9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/family2/testCompactionWithHFileLink=442deadaba9fce82374166dd2c4e6d7a-1ddb43c04ff54d2a843b199ad0ec07e9 2023-11-18 00:55:17,193 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:17,193 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:17,194 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:17,194 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:17,195 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311180fadc8b4c4f44158bae87a39c604250e 2023-11-18 00:55:17,196 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311180d317a111f4b44e0b249d08807b61849 2023-11-18 00:55:17,197 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111861aa86197c5f497bad41d0fa4e699279 2023-11-18 00:55:17,198 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023111896052333612143cca2eb61ed3cd42234 2023-11-18 00:55:17,199 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311188c685d4afc0a4313a79ed17714f157d5 2023-11-18 00:55:17,199 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118d4c6c3427fe144c5ba30c6e7a591c72c 2023-11-18 00:55:17,201 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111898f895343e6a4e3c81b7a1d215d593fd 2023-11-18 00:55:17,201 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 00:55:17,201 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118' 2023-11-18 00:55:17,201 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118d6489f4b287c4a75a3c9bb477a648985 2023-11-18 00:55:17,201 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 00:55:17,201 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 00:55:17,201 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:17,202 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:17,202 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family2/7408185467aa4f8facb77d5a7d86d002 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/7408185467aa4f8facb77d5a7d86d002 2023-11-18 00:55:17,206 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in cfa25bcf33a8406213d9a872fe13b7d1/family2 of cfa25bcf33a8406213d9a872fe13b7d1 into 7408185467aa4f8facb77d5a7d86d002(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:17,206 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:17,206 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1., storeName=cfa25bcf33a8406213d9a872fe13b7d1/family2, priority=12, startTime=1700268916334; duration=0sec 2023-11-18 00:55:17,206 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-18 00:55:17,207 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 00:55:17,209 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 00:55:17,209 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1912): 7303eedc2c2e47c9b75c5b6fa37c67a7/family2 is initiating minor compaction (all files) 2023-11-18 00:55:17,209 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 7303eedc2c2e47c9b75c5b6fa37c67a7/family2 in testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:17,209 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-ed03bb6e4e5b4f818a6b2ab367fdf3f0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-7c8cc1644db0418abf429b716ab53965, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-a4913979410f4abfab4bd5115f84cc29, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-74df5584be5a4eb098ade8ac332af1c8] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp, totalSize=20.4 K 2023-11-18 00:55:17,209 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-ed03bb6e4e5b4f818a6b2ab367fdf3f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895097 2023-11-18 00:55:17,210 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-7c8cc1644db0418abf429b716ab53965, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:17,210 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-a4913979410f4abfab4bd5115f84cc29, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:17,211 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-74df5584be5a4eb098ade8ac332af1c8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:17,222 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] throttle.PressureAwareThroughputController(145): 7303eedc2c2e47c9b75c5b6fa37c67a7#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:17,255 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/.tmp/family1/207686d064f7463d849391eb5da084e6 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/207686d064f7463d849391eb5da084e6 2023-11-18 00:55:17,259 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in cfa25bcf33a8406213d9a872fe13b7d1/family1 of cfa25bcf33a8406213d9a872fe13b7d1 into 207686d064f7463d849391eb5da084e6(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:17,259 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:55:17,259 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1., storeName=cfa25bcf33a8406213d9a872fe13b7d1/family1, priority=12, startTime=1700268916333; duration=0sec 2023-11-18 00:55:17,259 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-18 00:55:17,259 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 00:55:17,261 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 00:55:17,261 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1912): 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 is initiating minor compaction (all files) 2023-11-18 00:55:17,261 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 in testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:55:17,261 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-08e5ac76d4b74b2d979463e33a216ae6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-27088c31b03d43aeb9ef655978ddcaac, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-da04a313a3de40b0999c0913a74dcd53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-263a1dbd5a294a08b43db97afe0128ef] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp, totalSize=21.6 K 2023-11-18 00:55:17,262 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-08e5ac76d4b74b2d979463e33a216ae6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268895097 2023-11-18 00:55:17,262 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-27088c31b03d43aeb9ef655978ddcaac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268896892 2023-11-18 00:55:17,263 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-da04a313a3de40b0999c0913a74dcd53, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268898706 2023-11-18 00:55:17,263 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-263a1dbd5a294a08b43db97afe0128ef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268900502 2023-11-18 00:55:17,275 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7303eedc2c2e47c9b75c5b6fa37c67a7#family1#compaction#119 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:17,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-96bbe44d8d9941d7a26822d1a731a53d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-01ca07db7a334b5da1cb7b7bbb71d185, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-5a8894ca4545419887a124e3a13168f5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-ea672d23bb424cfba0b0e1abcc5f4bbb] to archive 2023-11-18 00:55:17,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:17,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-96bbe44d8d9941d7a26822d1a731a53d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-96bbe44d8d9941d7a26822d1a731a53d 2023-11-18 00:55:17,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-01ca07db7a334b5da1cb7b7bbb71d185 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-01ca07db7a334b5da1cb7b7bbb71d185 2023-11-18 00:55:17,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-5a8894ca4545419887a124e3a13168f5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-5a8894ca4545419887a124e3a13168f5 2023-11-18 00:55:17,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-ea672d23bb424cfba0b0e1abcc5f4bbb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family1/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-ea672d23bb424cfba0b0e1abcc5f4bbb 2023-11-18 00:55:17,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-bb828e9bf7274ca0881069b84580cb39, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-a2dbfbf01a384ad29818ea368842e94d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-86a1eacd04814518bf608cf9947b75b4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-4b184040f04c46308a3d217275349b26] to archive 2023-11-18 00:55:17,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:17,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-bb828e9bf7274ca0881069b84580cb39 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-bb828e9bf7274ca0881069b84580cb39 2023-11-18 00:55:17,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-a2dbfbf01a384ad29818ea368842e94d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-a2dbfbf01a384ad29818ea368842e94d 2023-11-18 00:55:17,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-86a1eacd04814518bf608cf9947b75b4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-86a1eacd04814518bf608cf9947b75b4 2023-11-18 00:55:17,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-4b184040f04c46308a3d217275349b26 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/family2/testCompactionWithHFileLink=cfa25bcf33a8406213d9a872fe13b7d1-4b184040f04c46308a3d217275349b26 2023-11-18 00:55:17,864 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118d19b5ced45c34a239ca0b6dd91c85baa to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118d19b5ced45c34a239ca0b6dd91c85baa 2023-11-18 00:55:17,865 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:17,889 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/b41f92a7417a48159ae15a73f3125c9f first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-18 00:55:17,890 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=32 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/b41f92a7417a48159ae15a73f3125c9f}] 2023-11-18 00:55:17,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/b41f92a7417a48159ae15a73f3125c9f for inclusion in 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 2023-11-18 00:55:17,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-18 00:55:17,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last=1 2023-11-18 00:55:17,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:17,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/b41f92a7417a48159ae15a73f3125c9f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__6r7anhvfrut9nuo6upbgqeacqlp6rrvrljh3herj3s7fba7votvc0sl3pkml7cd0/family1/b41f92a7417a48159ae15a73f3125c9f 2023-11-18 00:55:17,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__6r7anhvfrut9nuo6upbgqeacqlp6rrvrljh3herj3s7fba7votvc0sl3pkml7cd0/family1/b41f92a7417a48159ae15a73f3125c9f as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/73c933c22712417497dd8461fbd879af_SeqId_34_ 2023-11-18 00:55:17,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__6r7anhvfrut9nuo6upbgqeacqlp6rrvrljh3herj3s7fba7votvc0sl3pkml7cd0/family1/b41f92a7417a48159ae15a73f3125c9f into 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/73c933c22712417497dd8461fbd879af_SeqId_34_ - updating store file list. 2023-11-18 00:55:17,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/73c933c22712417497dd8461fbd879af_SeqId_34_ into 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 2023-11-18 00:55:17,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__6r7anhvfrut9nuo6upbgqeacqlp6rrvrljh3herj3s7fba7votvc0sl3pkml7cd0/family1/b41f92a7417a48159ae15a73f3125c9f into 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/73c933c22712417497dd8461fbd879af_SeqId_34_) 2023-11-18 00:55:17,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testCompactionWithHFileLink__6r7anhvfrut9nuo6upbgqeacqlp6rrvrljh3herj3s7fba7votvc0sl3pkml7cd0/family1/b41f92a7417a48159ae15a73f3125c9f 2023-11-18 00:55:17,903 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:17,904 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:17,906 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111877db835e318a4afd8ab9a7ab3c0e189e 2023-11-18 00:55:17,907 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118b07bf1515a974434b4a2451308d3d5c2 2023-11-18 00:55:17,908 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118cdcb9d2107814ce5ad424bbb74eeb535 2023-11-18 00:55:17,909 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118e66ea85a8af34ba28807f313d3ad86ed 2023-11-18 00:55:17,909 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 00:55:17,909 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 00:55:17,910 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 00:55:17,910 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-18 00:55:17,912 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:17,916 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:17,922 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:17,923 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:17,929 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:17,929 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:17,945 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=281 (was 239) - Thread LEAK? -, OpenFileDescriptor=759 (was 620) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=152 (was 118) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=9569 (was 9189) - AvailableMemoryMB LEAK? - 2023-11-18 00:55:17,956 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=281, OpenFileDescriptor=759, MaxFileDescriptor=60000, SystemLoadAverage=152, ProcessCount=167, AvailableMemoryMB=9569 2023-11-18 00:55:17,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-18 00:55:17,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-18 00:55:17,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-18 00:55:17,968 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-18 00:55:17,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-11-18 00:55:18,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-18 00:55:18,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 00:55:18,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-18 00:55:18,072 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:55:18,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-18 00:55:18,072 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:55:18,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 00:55:18,074 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:18,074 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:18,074 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:18,074 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9 empty. 2023-11-18 00:55:18,074 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0 empty. 2023-11-18 00:55:18,075 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac empty. 2023-11-18 00:55:18,075 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:18,075 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:18,075 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:18,075 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-18 00:55:18,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 00:55:18,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 00:55:18,440 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family2/1a3490db334549c9bd910894819f9533 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/1a3490db334549c9bd910894819f9533 2023-11-18 00:55:18,449 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 7303eedc2c2e47c9b75c5b6fa37c67a7/family2 of 7303eedc2c2e47c9b75c5b6fa37c67a7 into 1a3490db334549c9bd910894819f9533(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:18,449 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:18,449 INFO [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7., storeName=7303eedc2c2e47c9b75c5b6fa37c67a7/family2, priority=12, startTime=1700268916461; duration=1sec 2023-11-18 00:55:18,449 DEBUG [RS:0;jenkins-hbase4:46287-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:18,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-ed03bb6e4e5b4f818a6b2ab367fdf3f0, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-7c8cc1644db0418abf429b716ab53965, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-a4913979410f4abfab4bd5115f84cc29, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-74df5584be5a4eb098ade8ac332af1c8] to archive 2023-11-18 00:55:18,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:18,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-ed03bb6e4e5b4f818a6b2ab367fdf3f0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-ed03bb6e4e5b4f818a6b2ab367fdf3f0 2023-11-18 00:55:18,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-7c8cc1644db0418abf429b716ab53965 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-7c8cc1644db0418abf429b716ab53965 2023-11-18 00:55:18,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-a4913979410f4abfab4bd5115f84cc29 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-a4913979410f4abfab4bd5115f84cc29 2023-11-18 00:55:18,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-74df5584be5a4eb098ade8ac332af1c8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family2/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-74df5584be5a4eb098ade8ac332af1c8 2023-11-18 00:55:18,481 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-18 00:55:18,483 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => f1e151a6eb43f2e0c44c3327d04ea7ac, NAME => 'ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:55:18,483 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9ad934b32fe540cf4771712205d429e0, NAME => 'ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:55:18,483 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4a4768ae6fe039be8e8dbafffed156f9, NAME => 'ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:55:18,499 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/.tmp/family1/1d570a1dc822403990cb8df7a5d42255 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/1d570a1dc822403990cb8df7a5d42255 2023-11-18 00:55:18,503 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 7303eedc2c2e47c9b75c5b6fa37c67a7/family1 of 7303eedc2c2e47c9b75c5b6fa37c67a7 into 1d570a1dc822403990cb8df7a5d42255(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:18,504 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:55:18,504 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7., storeName=7303eedc2c2e47c9b75c5b6fa37c67a7/family1, priority=12, startTime=1700268916461; duration=1sec 2023-11-18 00:55:18,504 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:18,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-08e5ac76d4b74b2d979463e33a216ae6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-27088c31b03d43aeb9ef655978ddcaac, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-da04a313a3de40b0999c0913a74dcd53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-263a1dbd5a294a08b43db97afe0128ef] to archive 2023-11-18 00:55:18,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:18,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-08e5ac76d4b74b2d979463e33a216ae6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-08e5ac76d4b74b2d979463e33a216ae6 2023-11-18 00:55:18,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-27088c31b03d43aeb9ef655978ddcaac to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-27088c31b03d43aeb9ef655978ddcaac 2023-11-18 00:55:18,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-da04a313a3de40b0999c0913a74dcd53 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-da04a313a3de40b0999c0913a74dcd53 2023-11-18 00:55:18,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-263a1dbd5a294a08b43db97afe0128ef to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/family1/testCompactionWithHFileLink=7303eedc2c2e47c9b75c5b6fa37c67a7-263a1dbd5a294a08b43db97afe0128ef 2023-11-18 00:55:18,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 00:55:18,889 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:18,889 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:18,889 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing f1e151a6eb43f2e0c44c3327d04ea7ac, disabling compactions & flushes 2023-11-18 00:55:18,889 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 9ad934b32fe540cf4771712205d429e0, disabling compactions & flushes 2023-11-18 00:55:18,889 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:18,889 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:18,889 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:18,890 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:18,890 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. after waiting 0 ms 2023-11-18 00:55:18,890 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:18,889 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. after waiting 0 ms 2023-11-18 00:55:18,890 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:18,890 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:18,890 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:18,890 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:18,890 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:18,898 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:18,898 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 4a4768ae6fe039be8e8dbafffed156f9, disabling compactions & flushes 2023-11-18 00:55:18,898 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:18,898 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:18,898 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. after waiting 0 ms 2023-11-18 00:55:18,898 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:18,898 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:18,898 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:18,900 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:55:18,901 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700268918901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268918901"}]},"ts":"1700268918901"} 2023-11-18 00:55:18,901 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700268918901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268918901"}]},"ts":"1700268918901"} 2023-11-18 00:55:18,901 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700268918901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268918901"}]},"ts":"1700268918901"} 2023-11-18 00:55:18,903 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 00:55:18,904 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:55:18,904 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268918904"}]},"ts":"1700268918904"} 2023-11-18 00:55:18,905 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-18 00:55:18,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4a4768ae6fe039be8e8dbafffed156f9, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9ad934b32fe540cf4771712205d429e0, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f1e151a6eb43f2e0c44c3327d04ea7ac, ASSIGN}] 2023-11-18 00:55:18,921 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9ad934b32fe540cf4771712205d429e0, ASSIGN 2023-11-18 00:55:18,921 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f1e151a6eb43f2e0c44c3327d04ea7ac, ASSIGN 2023-11-18 00:55:18,922 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4a4768ae6fe039be8e8dbafffed156f9, ASSIGN 2023-11-18 00:55:18,922 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9ad934b32fe540cf4771712205d429e0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:55:18,922 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f1e151a6eb43f2e0c44c3327d04ea7ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:55:18,922 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4a4768ae6fe039be8e8dbafffed156f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:55:19,075 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9ad934b32fe540cf4771712205d429e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:19,075 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=f1e151a6eb43f2e0c44c3327d04ea7ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:19,075 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4a4768ae6fe039be8e8dbafffed156f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:19,075 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700268919075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268919075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268919075"}]},"ts":"1700268919075"} 2023-11-18 00:55:19,075 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700268919075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268919075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268919075"}]},"ts":"1700268919075"} 2023-11-18 00:55:19,075 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700268919075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268919075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268919075"}]},"ts":"1700268919075"} 2023-11-18 00:55:19,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9ad934b32fe540cf4771712205d429e0, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:19,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure f1e151a6eb43f2e0c44c3327d04ea7ac, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:19,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 4a4768ae6fe039be8e8dbafffed156f9, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:19,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 00:55:19,228 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:19,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:19,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ad934b32fe540cf4771712205d429e0, NAME => 'ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 00:55:19,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:19,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:19,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:19,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:19,232 INFO [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:19,234 DEBUG [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1 2023-11-18 00:55:19,234 DEBUG [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1 2023-11-18 00:55:19,234 INFO [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ad934b32fe540cf4771712205d429e0 columnFamilyName family1 2023-11-18 00:55:19,235 INFO [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] regionserver.HStore(310): Store=9ad934b32fe540cf4771712205d429e0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:19,235 INFO [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:19,236 DEBUG [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2 2023-11-18 00:55:19,236 DEBUG [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2 2023-11-18 00:55:19,236 INFO [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ad934b32fe540cf4771712205d429e0 columnFamilyName family2 2023-11-18 00:55:19,238 INFO [StoreOpener-9ad934b32fe540cf4771712205d429e0-1] regionserver.HStore(310): Store=9ad934b32fe540cf4771712205d429e0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:19,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:19,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:19,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:19,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9ad934b32fe540cf4771712205d429e0 2023-11-18 00:55:19,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:55:19,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9ad934b32fe540cf4771712205d429e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62106248, jitterRate=-0.07454478740692139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:19,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:19,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0., pid=109, masterSystemTime=1700268919228 2023-11-18 00:55:19,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:19,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:19,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:19,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1e151a6eb43f2e0c44c3327d04ea7ac, NAME => 'ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 00:55:19,245 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9ad934b32fe540cf4771712205d429e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:19,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:19,245 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700268919245"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268919245"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268919245"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268919245"}]},"ts":"1700268919245"} 2023-11-18 00:55:19,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:19,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:19,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:19,247 INFO [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:19,248 DEBUG [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1 2023-11-18 00:55:19,248 DEBUG [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1 2023-11-18 00:55:19,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-11-18 00:55:19,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9ad934b32fe540cf4771712205d429e0, server=jenkins-hbase4.apache.org,46287,1700268799711 in 170 msec 2023-11-18 00:55:19,248 INFO [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1e151a6eb43f2e0c44c3327d04ea7ac columnFamilyName family1 2023-11-18 00:55:19,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9ad934b32fe540cf4771712205d429e0, ASSIGN in 329 msec 2023-11-18 00:55:19,249 INFO [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] regionserver.HStore(310): Store=f1e151a6eb43f2e0c44c3327d04ea7ac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:19,249 INFO [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:19,250 DEBUG [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2 2023-11-18 00:55:19,250 DEBUG [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2 2023-11-18 00:55:19,251 INFO [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1e151a6eb43f2e0c44c3327d04ea7ac columnFamilyName family2 2023-11-18 00:55:19,251 INFO [StoreOpener-f1e151a6eb43f2e0c44c3327d04ea7ac-1] regionserver.HStore(310): Store=f1e151a6eb43f2e0c44c3327d04ea7ac/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:19,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:19,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:19,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:19,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:55:19,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:55:19,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1e151a6eb43f2e0c44c3327d04ea7ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65454992, jitterRate=-0.02464461326599121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:19,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:19,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac., pid=110, masterSystemTime=1700268919228 2023-11-18 00:55:19,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:19,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:19,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:19,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a4768ae6fe039be8e8dbafffed156f9, NAME => 'ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 00:55:19,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=f1e151a6eb43f2e0c44c3327d04ea7ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:19,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:19,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:19,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700268919257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268919257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268919257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268919257"}]},"ts":"1700268919257"} 2023-11-18 00:55:19,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:19,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:19,259 INFO [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:19,260 DEBUG [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1 2023-11-18 00:55:19,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=108 2023-11-18 00:55:19,260 DEBUG [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1 2023-11-18 00:55:19,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure f1e151a6eb43f2e0c44c3327d04ea7ac, server=jenkins-hbase4.apache.org,46287,1700268799711 in 182 msec 2023-11-18 00:55:19,260 INFO [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a4768ae6fe039be8e8dbafffed156f9 columnFamilyName family1 2023-11-18 00:55:19,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f1e151a6eb43f2e0c44c3327d04ea7ac, ASSIGN in 341 msec 2023-11-18 00:55:19,261 INFO [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] regionserver.HStore(310): Store=4a4768ae6fe039be8e8dbafffed156f9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:19,261 INFO [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:19,262 DEBUG [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2 2023-11-18 00:55:19,262 DEBUG [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2 2023-11-18 00:55:19,262 INFO [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a4768ae6fe039be8e8dbafffed156f9 columnFamilyName family2 2023-11-18 00:55:19,263 INFO [StoreOpener-4a4768ae6fe039be8e8dbafffed156f9-1] regionserver.HStore(310): Store=4a4768ae6fe039be8e8dbafffed156f9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:19,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:19,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:19,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:19,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:55:19,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:55:19,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a4768ae6fe039be8e8dbafffed156f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63023991, jitterRate=-0.06086935102939606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:19,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:19,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9., pid=111, masterSystemTime=1700268919228 2023-11-18 00:55:19,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:19,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:19,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4a4768ae6fe039be8e8dbafffed156f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:19,270 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700268919270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268919270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268919270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268919270"}]},"ts":"1700268919270"} 2023-11-18 00:55:19,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=106 2023-11-18 00:55:19,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 4a4768ae6fe039be8e8dbafffed156f9, server=jenkins-hbase4.apache.org,46287,1700268799711 in 193 msec 2023-11-18 00:55:19,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-11-18 00:55:19,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4a4768ae6fe039be8e8dbafffed156f9, ASSIGN in 353 msec 2023-11-18 00:55:19,274 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:55:19,274 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268919274"}]},"ts":"1700268919274"} 2023-11-18 00:55:19,275 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-18 00:55:19,277 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:55:19,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2080 sec 2023-11-18 00:55:19,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:55:20,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 00:55:20,177 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-18 00:55:20,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:20,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:20,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:20,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:20,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 00:55:20,188 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 00:55:20,188 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:20,188 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 00:55:20,188 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 00:55:20,188 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:20,188 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:20,189 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:20,189 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:20,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:20,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:20,190 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:20,190 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:20,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:20,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:20,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:20,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:20,191 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 00:55:20,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 00:55:20,191 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 00:55:20,191 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:20,191 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 00:55:20,191 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:20,191 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. started... 2023-11-18 00:55:20,191 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:20,191 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:20,191 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:20,193 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1e151a6eb43f2e0c44c3327d04ea7ac 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:55:20,191 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:20,193 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. started... 2023-11-18 00:55:20,193 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. started... 2023-11-18 00:55:20,193 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9ad934b32fe540cf4771712205d429e0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:55:20,193 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4a4768ae6fe039be8e8dbafffed156f9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:55:20,210 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118bb9ad83d24d7466dbe4bdac35b959a84 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118bb9ad83d24d7466dbe4bdac35b959a84 2023-11-18 00:55:20,210 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311184b753c600cd347b88817b0dd4d383f38 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311184b753c600cd347b88817b0dd4d383f38 2023-11-18 00:55:20,608 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118afe3e038c121439db080207d94f44f50 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231118afe3e038c121439db080207d94f44f50 2023-11-18 00:55:20,619 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/5e0e7d5515854a738102c0b003dfc01d 2023-11-18 00:55:20,619 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/d313884483b94fe7a1bb86ce8885b5d5 2023-11-18 00:55:21,013 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/ce396b297cf845c7a0d27b01ce4c2aa2 2023-11-18 00:55:21,026 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118a32a42d2fce4472ab87383898471de2f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231118a32a42d2fce4472ab87383898471de2f 2023-11-18 00:55:21,030 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/3e3c9b347dc941558490566a64043f4a 2023-11-18 00:55:21,033 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118385438b4a10e422b891a39b846355361 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231118385438b4a10e422b891a39b846355361 2023-11-18 00:55:21,033 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311183cab714d3cf1415fbe79cb0507a996ae to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311183cab714d3cf1415fbe79cb0507a996ae 2023-11-18 00:55:21,034 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/ce396b297cf845c7a0d27b01ce4c2aa2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/ce396b297cf845c7a0d27b01ce4c2aa2 2023-11-18 00:55:21,039 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/ce396b297cf845c7a0d27b01ce4c2aa2, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 00:55:21,040 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/3e3c9b347dc941558490566a64043f4a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/3e3c9b347dc941558490566a64043f4a 2023-11-18 00:55:21,044 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/3e3c9b347dc941558490566a64043f4a, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:55:21,044 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4a4768ae6fe039be8e8dbafffed156f9 in 851ms, sequenceid=5, compaction requested=false 2023-11-18 00:55:21,045 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-18 00:55:21,045 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:21,045 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:21,045 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:21,443 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/0b39944fef4449e390980f3970ae800b 2023-11-18 00:55:21,443 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/bf0e56b5a5b94fcca1dad06cef0aca52 2023-11-18 00:55:21,448 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/d313884483b94fe7a1bb86ce8885b5d5 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/d313884483b94fe7a1bb86ce8885b5d5 2023-11-18 00:55:21,448 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/5e0e7d5515854a738102c0b003dfc01d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/5e0e7d5515854a738102c0b003dfc01d 2023-11-18 00:55:21,451 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/d313884483b94fe7a1bb86ce8885b5d5, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 00:55:21,452 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/5e0e7d5515854a738102c0b003dfc01d, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 00:55:21,452 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/0b39944fef4449e390980f3970ae800b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/0b39944fef4449e390980f3970ae800b 2023-11-18 00:55:21,453 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/bf0e56b5a5b94fcca1dad06cef0aca52 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bf0e56b5a5b94fcca1dad06cef0aca52 2023-11-18 00:55:21,456 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/0b39944fef4449e390980f3970ae800b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:55:21,457 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bf0e56b5a5b94fcca1dad06cef0aca52, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:55:21,457 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9ad934b32fe540cf4771712205d429e0 in 1264ms, sequenceid=5, compaction requested=false 2023-11-18 00:55:21,458 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:21,458 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:21,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:21,458 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f1e151a6eb43f2e0c44c3327d04ea7ac in 1265ms, sequenceid=5, compaction requested=false 2023-11-18 00:55:21,458 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:21,458 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:21,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:21,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:21,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 00:55:21,458 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 00:55:21,460 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,460 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:21,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:21,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:21,461 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:21,461 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:21,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:21,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:21,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:21,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:21,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 00:55:21,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1eec1bd4[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:21,462 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 00:55:21,462 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:21,464 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:21,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:21,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:21,464 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 00:55:21,464 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 00:55:21,464 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:21,464 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,464 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:21,466 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 00:55:21,466 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:21,466 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,466 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 00:55:21,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:21,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:21,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:21,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:21,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:21,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:21,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 00:55:21,469 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 00:55:21,469 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:21,469 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:21,469 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 00:55:21,469 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:21,472 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,472 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:21,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,472 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:21,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:21,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:21,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:21,472 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:21,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:21,474 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:21,477 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:21,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:21,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:21,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 00:55:21,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:21,477 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:21,478 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:21,478 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:21,578 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:21,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:21,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:21,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:21,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:21,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:21,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:21,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 00:55:21,584 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 00:55:21,584 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:21,584 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 00:55:21,584 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 00:55:21,585 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,585 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:21,586 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,586 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:21,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:21,586 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:21,586 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:21,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:21,587 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 00:55:21,588 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-18 00:55:21,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 00:55:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 00:55:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 00:55:21,588 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:21,588 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:21,588 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:21,588 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. started... 2023-11-18 00:55:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:21,588 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. started... 2023-11-18 00:55:21,588 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9ad934b32fe540cf4771712205d429e0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:55:21,588 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. started... 2023-11-18 00:55:21,588 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4a4768ae6fe039be8e8dbafffed156f9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:55:21,588 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1e151a6eb43f2e0c44c3327d04ea7ac 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:55:21,617 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118e62c8ece131e48e68f9d7269b38da70b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118e62c8ece131e48e68f9d7269b38da70b 2023-11-18 00:55:22,014 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311187f54d365481c4dde95e9630e72c490ce to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311187f54d365481c4dde95e9630e72c490ce 2023-11-18 00:55:22,014 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118edf84248952a4c6ba957ae2c6fa7ca63 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231118edf84248952a4c6ba957ae2c6fa7ca63 2023-11-18 00:55:22,019 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/00923e89d6554f8ab0da8dbda78e1147 2023-11-18 00:55:22,024 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/fcc01258558b4893af8f744d0feccf52 2023-11-18 00:55:22,420 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/6ad50e4779404046903b7b27a7d03f26 2023-11-18 00:55:22,431 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118e7b8215007b64ec6b3524e87efc23e03 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231118e7b8215007b64ec6b3524e87efc23e03 2023-11-18 00:55:22,436 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118de26d4513b6d498fa4bdb14011af5a9b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231118de26d4513b6d498fa4bdb14011af5a9b 2023-11-18 00:55:22,444 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/4e86bbda732d430481459449c08dc3c6 2023-11-18 00:55:22,448 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/fcc01258558b4893af8f744d0feccf52 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/fcc01258558b4893af8f744d0feccf52 2023-11-18 00:55:22,451 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/fcc01258558b4893af8f744d0feccf52, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 00:55:22,451 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/4e86bbda732d430481459449c08dc3c6 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/4e86bbda732d430481459449c08dc3c6 2023-11-18 00:55:22,454 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/4e86bbda732d430481459449c08dc3c6, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:55:22,455 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f1e151a6eb43f2e0c44c3327d04ea7ac in 867ms, sequenceid=9, compaction requested=false 2023-11-18 00:55:22,455 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:22,455 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:22,455 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:22,844 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:55:22,844 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/d50b8938f56c4c1092cdf7d181c38961 2023-11-18 00:55:22,844 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12a7fd82 to 127.0.0.1:58527 2023-11-18 00:55:22,844 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:55:22,846 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:55:22,846 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ad6c499 to 127.0.0.1:58527 2023-11-18 00:55:22,846 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:55:22,846 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:55:22,846 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66f0040a to 127.0.0.1:58527 2023-11-18 00:55:22,846 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:55:22,848 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111823e8f2fece294b0ea16e8275ad45c3f1 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111823e8f2fece294b0ea16e8275ad45c3f1 2023-11-18 00:55:22,855 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/00923e89d6554f8ab0da8dbda78e1147 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/00923e89d6554f8ab0da8dbda78e1147 2023-11-18 00:55:22,858 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/00923e89d6554f8ab0da8dbda78e1147, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 00:55:22,859 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/d50b8938f56c4c1092cdf7d181c38961 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/d50b8938f56c4c1092cdf7d181c38961 2023-11-18 00:55:22,863 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/d50b8938f56c4c1092cdf7d181c38961, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:55:22,864 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9ad934b32fe540cf4771712205d429e0 in 1276ms, sequenceid=9, compaction requested=false 2023-11-18 00:55:22,864 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:22,864 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:22,864 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:23,258 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/80dd1f9c529843c59e8dcf415027b302 2023-11-18 00:55:23,262 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/6ad50e4779404046903b7b27a7d03f26 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/6ad50e4779404046903b7b27a7d03f26 2023-11-18 00:55:23,265 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/6ad50e4779404046903b7b27a7d03f26, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 00:55:23,266 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/80dd1f9c529843c59e8dcf415027b302 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/80dd1f9c529843c59e8dcf415027b302 2023-11-18 00:55:23,269 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/80dd1f9c529843c59e8dcf415027b302, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:55:23,269 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4a4768ae6fe039be8e8dbafffed156f9 in 1681ms, sequenceid=9, compaction requested=false 2023-11-18 00:55:23,270 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:23,270 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 00:55:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 00:55:23,272 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,272 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:23,272 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:23,272 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:23,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 00:55:23,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63f5ee48[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:23,274 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 00:55:23,274 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:23,275 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:23,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:23,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:23,275 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 00:55:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 00:55:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:23,276 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,276 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:23,278 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,278 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 00:55:23,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:23,278 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:23,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:23,278 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 00:55:23,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:23,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:23,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:23,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:23,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 00:55:23,280 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 00:55:23,281 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:23,281 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:23,281 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 00:55:23,281 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:23,282 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,282 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:23,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,282 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:23,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:23,283 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,284 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,286 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,286 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:23,286 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:23,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:23,287 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:23,287 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:23,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 00:55:23,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:23,287 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:23,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:23,287 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,287 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:23,287 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:23,287 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,287 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:23,287 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:23,387 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:23,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:23,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:23,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:23,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:23,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:23,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:23,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 00:55:23,393 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 00:55:23,393 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:23,393 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 00:55:23,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 00:55:23,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,394 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:23,395 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,395 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:23,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:23,396 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:23,396 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:23,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:23,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 00:55:23,397 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-18 00:55:23,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 00:55:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 00:55:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 00:55:23,397 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:23,397 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. started... 2023-11-18 00:55:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:23,397 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:23,397 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:23,397 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. started... 2023-11-18 00:55:23,397 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1e151a6eb43f2e0c44c3327d04ea7ac 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:55:23,397 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. started... 2023-11-18 00:55:23,397 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4a4768ae6fe039be8e8dbafffed156f9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:55:23,398 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9ad934b32fe540cf4771712205d429e0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:55:23,422 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311186f757fde84c7464a8014d50aee65b185 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311186f757fde84c7464a8014d50aee65b185 2023-11-18 00:55:23,424 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311186f8c16b2c2ad4f0db567d94b2156c4e9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311186f8c16b2c2ad4f0db567d94b2156c4e9 2023-11-18 00:55:23,814 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118e814c74632bc4606a1e4002275746226 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118e814c74632bc4606a1e4002275746226 2023-11-18 00:55:23,831 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/e9c479f4467b42ab8ba58ebc70ea85e4 2023-11-18 00:55:23,834 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/4ddbc543373242a9a313de8da5762dcc 2023-11-18 00:55:24,219 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/f7bf731fda7d4395bccc3b9a0300cf6d 2023-11-18 00:55:24,243 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311180c093b08f92a4d68974a1f02ccaa38fb to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311180c093b08f92a4d68974a1f02ccaa38fb 2023-11-18 00:55:24,246 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311188b712bbd007b4258a866e19f4e2ba00c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311188b712bbd007b4258a866e19f4e2ba00c 2023-11-18 00:55:24,632 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311189247fafbc2db4c86864a572fbe81bdda to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311189247fafbc2db4c86864a572fbe81bdda 2023-11-18 00:55:24,648 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/7a1fd7bd0dad4ebb99b1b9b4459c16d6 2023-11-18 00:55:24,650 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/d672b6028c21433e8b77f0d7c9e5c02f 2023-11-18 00:55:24,651 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/e9c479f4467b42ab8ba58ebc70ea85e4 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/e9c479f4467b42ab8ba58ebc70ea85e4 2023-11-18 00:55:24,654 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/4ddbc543373242a9a313de8da5762dcc as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/4ddbc543373242a9a313de8da5762dcc 2023-11-18 00:55:24,655 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/e9c479f4467b42ab8ba58ebc70ea85e4, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 00:55:24,656 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/7a1fd7bd0dad4ebb99b1b9b4459c16d6 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7a1fd7bd0dad4ebb99b1b9b4459c16d6 2023-11-18 00:55:24,658 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/4ddbc543373242a9a313de8da5762dcc, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 00:55:24,658 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/d672b6028c21433e8b77f0d7c9e5c02f as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/d672b6028c21433e8b77f0d7c9e5c02f 2023-11-18 00:55:24,659 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7a1fd7bd0dad4ebb99b1b9b4459c16d6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:55:24,660 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9ad934b32fe540cf4771712205d429e0 in 1262ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:24,660 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:24,660 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:24,660 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:24,662 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/d672b6028c21433e8b77f0d7c9e5c02f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:55:24,662 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4a4768ae6fe039be8e8dbafffed156f9 in 1265ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:24,663 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:24,663 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:24,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:24,733 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:55:25,037 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/bb7468a9ecee465d8a664a5e13958e6e 2023-11-18 00:55:25,041 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/f7bf731fda7d4395bccc3b9a0300cf6d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/f7bf731fda7d4395bccc3b9a0300cf6d 2023-11-18 00:55:25,044 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/f7bf731fda7d4395bccc3b9a0300cf6d, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 00:55:25,045 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/bb7468a9ecee465d8a664a5e13958e6e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bb7468a9ecee465d8a664a5e13958e6e 2023-11-18 00:55:25,048 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bb7468a9ecee465d8a664a5e13958e6e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:55:25,049 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f1e151a6eb43f2e0c44c3327d04ea7ac in 1652ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:25,049 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:25,049 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:25,049 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:25,049 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:25,049 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,049 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 00:55:25,050 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 00:55:25,054 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:25,054 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:25,054 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:25,054 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:25,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 00:55:25,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@215504f1[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:25,055 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 00:55:25,055 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:25,057 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:25,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:25,057 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 00:55:25,057 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 00:55:25,057 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:25,057 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,057 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:25,058 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 00:55:25,058 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,058 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:25,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:25,058 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 00:55:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:25,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:25,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 00:55:25,061 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 00:55:25,061 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:25,061 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:25,061 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 00:55:25,061 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:25,067 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,067 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,067 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:25,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:25,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:25,067 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:25,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:25,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:25,069 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:25,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:25,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:25,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:25,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:25,072 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:25,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:25,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:25,073 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:25,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 00:55:25,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:25,073 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:25,073 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:25,173 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:25,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:25,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:25,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:25,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:25,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:25,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:25,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 00:55:25,180 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 00:55:25,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:25,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 00:55:25,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 00:55:25,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,180 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:25,182 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,182 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:25,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:25,182 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:25,182 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:25,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:25,183 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 00:55:25,183 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-18 00:55:25,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 00:55:25,183 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 00:55:25,183 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:25,183 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 00:55:25,183 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:25,183 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:25,183 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:25,184 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:25,184 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. started... 2023-11-18 00:55:25,183 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. started... 2023-11-18 00:55:25,184 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:25,184 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9ad934b32fe540cf4771712205d429e0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:25,184 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. started... 2023-11-18 00:55:25,184 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1e151a6eb43f2e0c44c3327d04ea7ac 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:25,184 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4a4768ae6fe039be8e8dbafffed156f9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:25,599 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118c39b85c6eb4d4958af00a972088db122 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118c39b85c6eb4d4958af00a972088db122 2023-11-18 00:55:25,600 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118778911d50f7640e798f0fc520ee26f98 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118778911d50f7640e798f0fc520ee26f98 2023-11-18 00:55:25,599 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118abce48d621c84677bacd1dc432627bd4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231118abce48d621c84677bacd1dc432627bd4 2023-11-18 00:55:25,605 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/888e99d68b50475d96e582654c2998a4 2023-11-18 00:55:26,004 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/8fa695dad2e04308afbc747440299be6 2023-11-18 00:55:26,006 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/5886455ea0df4ff7b3abb61d6b033be8 2023-11-18 00:55:26,017 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118ea9219da472e4384a968ba47661999b9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231118ea9219da472e4384a968ba47661999b9 2023-11-18 00:55:26,018 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118941d1c034b494579b43bd15580a51742 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231118941d1c034b494579b43bd15580a51742 2023-11-18 00:55:26,021 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/88790ad655d74298ab094ee4639f852a 2023-11-18 00:55:26,023 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/3a5107afdbdd455c8cf2b28965973b6b 2023-11-18 00:55:26,025 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/888e99d68b50475d96e582654c2998a4 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/888e99d68b50475d96e582654c2998a4 2023-11-18 00:55:26,027 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/8fa695dad2e04308afbc747440299be6 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8fa695dad2e04308afbc747440299be6 2023-11-18 00:55:26,029 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/888e99d68b50475d96e582654c2998a4, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 00:55:26,029 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/88790ad655d74298ab094ee4639f852a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/88790ad655d74298ab094ee4639f852a 2023-11-18 00:55:26,031 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8fa695dad2e04308afbc747440299be6, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 00:55:26,032 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/3a5107afdbdd455c8cf2b28965973b6b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/3a5107afdbdd455c8cf2b28965973b6b 2023-11-18 00:55:26,033 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/88790ad655d74298ab094ee4639f852a, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:26,034 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4a4768ae6fe039be8e8dbafffed156f9 in 850ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:26,034 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:26,034 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:26,034 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:26,035 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/3a5107afdbdd455c8cf2b28965973b6b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:26,036 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f1e151a6eb43f2e0c44c3327d04ea7ac in 852ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:26,036 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:26,036 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:26,036 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:26,420 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311180b2526681da94bafa920874e6461bd2a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311180b2526681da94bafa920874e6461bd2a 2023-11-18 00:55:26,825 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/bc5fb5eed909405c887bda32c77946dd 2023-11-18 00:55:26,829 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/5886455ea0df4ff7b3abb61d6b033be8 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/5886455ea0df4ff7b3abb61d6b033be8 2023-11-18 00:55:26,832 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/5886455ea0df4ff7b3abb61d6b033be8, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 00:55:26,833 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/bc5fb5eed909405c887bda32c77946dd as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/bc5fb5eed909405c887bda32c77946dd 2023-11-18 00:55:26,836 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/bc5fb5eed909405c887bda32c77946dd, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:26,837 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9ad934b32fe540cf4771712205d429e0 in 1653ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:26,837 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:26,837 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:26,837 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:26,837 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:26,837 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,837 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 00:55:26,837 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 00:55:26,839 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:26,839 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:26,839 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:26,839 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:26,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 00:55:26,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3834ec7a[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:26,841 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 00:55:26,841 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:26,842 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:26,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:26,842 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 00:55:26,842 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 00:55:26,842 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:26,842 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,842 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:26,844 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 00:55:26,844 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,844 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:26,844 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 00:55:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:26,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 00:55:26,847 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 00:55:26,847 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:26,847 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:26,847 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 00:55:26,847 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:26,849 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:26,849 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:26,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:26,849 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:26,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:26,850 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,851 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:26,854 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:26,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 00:55:26,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:26,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:26,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:26,854 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:26,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:26,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:26,954 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:26,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:26,966 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:26,975 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:26,982 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:26,983 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:27,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:27,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:27,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 00:55:27,014 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 00:55:27,014 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:27,014 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 00:55:27,014 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 00:55:27,014 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:27,014 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:27,015 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:27,016 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:27,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:27,016 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:27,016 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:27,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:27,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 00:55:27,017 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-18 00:55:27,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 00:55:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 00:55:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 00:55:27,017 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:27,017 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. started... 2023-11-18 00:55:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:27,017 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:27,017 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:27,017 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:27,017 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. started... 2023-11-18 00:55:27,017 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f1e151a6eb43f2e0c44c3327d04ea7ac 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:27,017 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. started... 2023-11-18 00:55:27,017 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4a4768ae6fe039be8e8dbafffed156f9 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:27,018 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9ad934b32fe540cf4771712205d429e0 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:27,434 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/a4ae6d40736a48f9bb43c65b8475dca0 2023-11-18 00:55:27,436 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/ba9cbceba08a47779207bc44df2baa49 2023-11-18 00:55:27,438 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4ae6d40736a48f9bb43c65b8475dca0 2023-11-18 00:55:27,439 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba9cbceba08a47779207bc44df2baa49 2023-11-18 00:55:27,834 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/3acb2d11b49545f8aff56a6d4b349265 2023-11-18 00:55:27,838 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3acb2d11b49545f8aff56a6d4b349265 2023-11-18 00:55:27,849 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/eaa86f4c92954c239cc3fb779f521dff 2023-11-18 00:55:27,849 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/7e2144b1eb5f46d3b007e0f04d34398e 2023-11-18 00:55:27,852 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eaa86f4c92954c239cc3fb779f521dff 2023-11-18 00:55:27,852 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e2144b1eb5f46d3b007e0f04d34398e 2023-11-18 00:55:27,853 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/ba9cbceba08a47779207bc44df2baa49 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/ba9cbceba08a47779207bc44df2baa49 2023-11-18 00:55:27,853 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/a4ae6d40736a48f9bb43c65b8475dca0 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/a4ae6d40736a48f9bb43c65b8475dca0 2023-11-18 00:55:27,856 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba9cbceba08a47779207bc44df2baa49 2023-11-18 00:55:27,856 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/ba9cbceba08a47779207bc44df2baa49, entries=3, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:27,856 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4ae6d40736a48f9bb43c65b8475dca0 2023-11-18 00:55:27,856 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/a4ae6d40736a48f9bb43c65b8475dca0, entries=3, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:27,857 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/eaa86f4c92954c239cc3fb779f521dff as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/eaa86f4c92954c239cc3fb779f521dff 2023-11-18 00:55:27,857 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/7e2144b1eb5f46d3b007e0f04d34398e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7e2144b1eb5f46d3b007e0f04d34398e 2023-11-18 00:55:27,862 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eaa86f4c92954c239cc3fb779f521dff 2023-11-18 00:55:27,862 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/eaa86f4c92954c239cc3fb779f521dff, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:27,862 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e2144b1eb5f46d3b007e0f04d34398e 2023-11-18 00:55:27,862 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7e2144b1eb5f46d3b007e0f04d34398e, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:27,863 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f1e151a6eb43f2e0c44c3327d04ea7ac in 846ms, sequenceid=23, compaction requested=true 2023-11-18 00:55:27,863 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9ad934b32fe540cf4771712205d429e0 in 845ms, sequenceid=23, compaction requested=true 2023-11-18 00:55:27,863 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:27,863 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:27,863 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:27,863 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:27,863 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:27,863 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:28,650 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/83e83f58919a4493b8095b7d3208bd14 2023-11-18 00:55:28,654 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83e83f58919a4493b8095b7d3208bd14 2023-11-18 00:55:28,654 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/3acb2d11b49545f8aff56a6d4b349265 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/3acb2d11b49545f8aff56a6d4b349265 2023-11-18 00:55:28,658 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3acb2d11b49545f8aff56a6d4b349265 2023-11-18 00:55:28,658 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/3acb2d11b49545f8aff56a6d4b349265, entries=3, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:28,658 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/83e83f58919a4493b8095b7d3208bd14 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/83e83f58919a4493b8095b7d3208bd14 2023-11-18 00:55:28,662 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83e83f58919a4493b8095b7d3208bd14 2023-11-18 00:55:28,662 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/83e83f58919a4493b8095b7d3208bd14, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:28,663 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4a4768ae6fe039be8e8dbafffed156f9 in 1646ms, sequenceid=23, compaction requested=true 2023-11-18 00:55:28,663 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:28,663 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 00:55:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 00:55:28,667 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,667 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:28,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:28,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:28,667 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:28,667 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:28,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:28,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 00:55:28,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46786213[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:28,669 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 00:55:28,669 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:28,671 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:28,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:28,671 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 00:55:28,671 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 00:55:28,671 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:28,671 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,671 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 00:55:28,673 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 00:55:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:28,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:28,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:28,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 00:55:28,675 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 00:55:28,676 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:28,676 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:28,676 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 00:55:28,676 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:28,678 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:28,678 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:28,678 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:28,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:28,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:28,678 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:28,680 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 00:55:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,683 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,683 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:28,683 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:28,684 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:28,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:28,684 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:28,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-18 00:55:28,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:28,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 00:55:28,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:28,684 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 00:55:28,684 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:28,684 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:28,684 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 00:55:28,684 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 00:55:28,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:28,684 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:28,684 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:28,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:28,784 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:28,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:28,786 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:28,786 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): f1e151a6eb43f2e0c44c3327d04ea7ac/family1 is initiating major compaction (all files) 2023-11-18 00:55:28,786 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:28,786 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:28,786 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of f1e151a6eb43f2e0c44c3327d04ea7ac/family1 in ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:28,786 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/5e0e7d5515854a738102c0b003dfc01d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/fcc01258558b4893af8f744d0feccf52, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/f7bf731fda7d4395bccc3b9a0300cf6d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8fa695dad2e04308afbc747440299be6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/ba9cbceba08a47779207bc44df2baa49] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp, totalSize=26.6 K 2023-11-18 00:55:28,787 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 5e0e7d5515854a738102c0b003dfc01d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268920184 2023-11-18 00:55:28,787 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting fcc01258558b4893af8f744d0feccf52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268921580 2023-11-18 00:55:28,787 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting f7bf731fda7d4395bccc3b9a0300cf6d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268923390 2023-11-18 00:55:28,788 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 8fa695dad2e04308afbc747440299be6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268925176 2023-11-18 00:55:28,788 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting ba9cbceba08a47779207bc44df2baa49, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:55:28,805 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): f1e151a6eb43f2e0c44c3327d04ea7ac#family1#compaction#150 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:29,213 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311188943d8e2c178454e9459e92212ed8f2c_del 2023-11-18 00:55:29,213 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311188943d8e2c178454e9459e92212ed8f2c_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311188943d8e2c178454e9459e92212ed8f2c_del 2023-11-18 00:55:30,026 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8e4fbda291a42f9ba2b52e929eb03d2 2023-11-18 00:55:30,026 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family1/f8e4fbda291a42f9ba2b52e929eb03d2 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/f8e4fbda291a42f9ba2b52e929eb03d2 2023-11-18 00:55:30,030 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8e4fbda291a42f9ba2b52e929eb03d2 2023-11-18 00:55:30,031 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f1e151a6eb43f2e0c44c3327d04ea7ac/family1 of f1e151a6eb43f2e0c44c3327d04ea7ac into f8e4fbda291a42f9ba2b52e929eb03d2(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:30,031 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:30,031 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:30,031 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): f1e151a6eb43f2e0c44c3327d04ea7ac/family2 is initiating major compaction (all files) 2023-11-18 00:55:30,031 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:30,031 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:30,032 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of f1e151a6eb43f2e0c44c3327d04ea7ac/family2 in ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:55:30,032 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bf0e56b5a5b94fcca1dad06cef0aca52, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/4e86bbda732d430481459449c08dc3c6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bb7468a9ecee465d8a664a5e13958e6e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/3a5107afdbdd455c8cf2b28965973b6b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/eaa86f4c92954c239cc3fb779f521dff] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp, totalSize=25.3 K 2023-11-18 00:55:30,032 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting bf0e56b5a5b94fcca1dad06cef0aca52, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268920184 2023-11-18 00:55:30,033 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 4e86bbda732d430481459449c08dc3c6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268921580 2023-11-18 00:55:30,033 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting bb7468a9ecee465d8a664a5e13958e6e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268923390 2023-11-18 00:55:30,033 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 3a5107afdbdd455c8cf2b28965973b6b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268925176 2023-11-18 00:55:30,034 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting eaa86f4c92954c239cc3fb779f521dff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:55:30,041 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): f1e151a6eb43f2e0c44c3327d04ea7ac#family2#compaction#151 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:30,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/5e0e7d5515854a738102c0b003dfc01d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/fcc01258558b4893af8f744d0feccf52, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/f7bf731fda7d4395bccc3b9a0300cf6d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8fa695dad2e04308afbc747440299be6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/ba9cbceba08a47779207bc44df2baa49] to archive 2023-11-18 00:55:30,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:30,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/5e0e7d5515854a738102c0b003dfc01d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/5e0e7d5515854a738102c0b003dfc01d 2023-11-18 00:55:30,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/fcc01258558b4893af8f744d0feccf52 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/fcc01258558b4893af8f744d0feccf52 2023-11-18 00:55:30,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/f7bf731fda7d4395bccc3b9a0300cf6d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/f7bf731fda7d4395bccc3b9a0300cf6d 2023-11-18 00:55:30,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8fa695dad2e04308afbc747440299be6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8fa695dad2e04308afbc747440299be6 2023-11-18 00:55:30,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/ba9cbceba08a47779207bc44df2baa49 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/ba9cbceba08a47779207bc44df2baa49 2023-11-18 00:55:30,450 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118be4567e5229444b49e5a8f6c027a5f6d_del 2023-11-18 00:55:30,450 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118be4567e5229444b49e5a8f6c027a5f6d_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231118be4567e5229444b49e5a8f6c027a5f6d_del 2023-11-18 00:55:31,263 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f4bfb7bc3784715aadf68f32ad4e03c 2023-11-18 00:55:31,264 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/.tmp/family2/2f4bfb7bc3784715aadf68f32ad4e03c as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/2f4bfb7bc3784715aadf68f32ad4e03c 2023-11-18 00:55:31,268 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f4bfb7bc3784715aadf68f32ad4e03c 2023-11-18 00:55:31,269 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f1e151a6eb43f2e0c44c3327d04ea7ac/family2 of f1e151a6eb43f2e0c44c3327d04ea7ac into 2f4bfb7bc3784715aadf68f32ad4e03c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:31,269 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:31,269 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:31,269 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 9ad934b32fe540cf4771712205d429e0/family1 is initiating major compaction (all files) 2023-11-18 00:55:31,270 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:31,270 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:31,270 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 9ad934b32fe540cf4771712205d429e0/family1 in ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:31,270 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/d313884483b94fe7a1bb86ce8885b5d5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/00923e89d6554f8ab0da8dbda78e1147, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/e9c479f4467b42ab8ba58ebc70ea85e4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/5886455ea0df4ff7b3abb61d6b033be8, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/a4ae6d40736a48f9bb43c65b8475dca0] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp, totalSize=26.6 K 2023-11-18 00:55:31,271 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting d313884483b94fe7a1bb86ce8885b5d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268920184 2023-11-18 00:55:31,271 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 00923e89d6554f8ab0da8dbda78e1147, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268921580 2023-11-18 00:55:31,271 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting e9c479f4467b42ab8ba58ebc70ea85e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268923389 2023-11-18 00:55:31,272 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 5886455ea0df4ff7b3abb61d6b033be8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268925176 2023-11-18 00:55:31,272 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting a4ae6d40736a48f9bb43c65b8475dca0, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:55:31,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bf0e56b5a5b94fcca1dad06cef0aca52, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/4e86bbda732d430481459449c08dc3c6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bb7468a9ecee465d8a664a5e13958e6e, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/3a5107afdbdd455c8cf2b28965973b6b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/eaa86f4c92954c239cc3fb779f521dff] to archive 2023-11-18 00:55:31,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:31,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bf0e56b5a5b94fcca1dad06cef0aca52 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bf0e56b5a5b94fcca1dad06cef0aca52 2023-11-18 00:55:31,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/4e86bbda732d430481459449c08dc3c6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/4e86bbda732d430481459449c08dc3c6 2023-11-18 00:55:31,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bb7468a9ecee465d8a664a5e13958e6e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/bb7468a9ecee465d8a664a5e13958e6e 2023-11-18 00:55:31,281 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 9ad934b32fe540cf4771712205d429e0#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:31,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/3a5107afdbdd455c8cf2b28965973b6b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/3a5107afdbdd455c8cf2b28965973b6b 2023-11-18 00:55:31,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/eaa86f4c92954c239cc3fb779f521dff to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family2/eaa86f4c92954c239cc3fb779f521dff 2023-11-18 00:55:31,698 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311184a7d994fbaa24046b3cd41b4a0d1ffaa_del 2023-11-18 00:55:31,698 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311184a7d994fbaa24046b3cd41b4a0d1ffaa_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311184a7d994fbaa24046b3cd41b4a0d1ffaa_del 2023-11-18 00:55:32,511 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8308228667ff4028a07e086dae1f4779 2023-11-18 00:55:32,512 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family1/8308228667ff4028a07e086dae1f4779 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/8308228667ff4028a07e086dae1f4779 2023-11-18 00:55:32,515 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8308228667ff4028a07e086dae1f4779 2023-11-18 00:55:32,516 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9ad934b32fe540cf4771712205d429e0/family1 of 9ad934b32fe540cf4771712205d429e0 into 8308228667ff4028a07e086dae1f4779(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:32,516 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:32,516 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:32,516 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 9ad934b32fe540cf4771712205d429e0/family2 is initiating major compaction (all files) 2023-11-18 00:55:32,516 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:32,516 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:32,517 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 9ad934b32fe540cf4771712205d429e0/family2 in ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:55:32,517 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/0b39944fef4449e390980f3970ae800b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/d50b8938f56c4c1092cdf7d181c38961, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7a1fd7bd0dad4ebb99b1b9b4459c16d6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/bc5fb5eed909405c887bda32c77946dd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7e2144b1eb5f46d3b007e0f04d34398e] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp, totalSize=25.3 K 2023-11-18 00:55:32,517 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 0b39944fef4449e390980f3970ae800b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268920184 2023-11-18 00:55:32,518 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting d50b8938f56c4c1092cdf7d181c38961, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268921580 2023-11-18 00:55:32,518 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 7a1fd7bd0dad4ebb99b1b9b4459c16d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268923389 2023-11-18 00:55:32,518 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting bc5fb5eed909405c887bda32c77946dd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268925176 2023-11-18 00:55:32,518 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 7e2144b1eb5f46d3b007e0f04d34398e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:55:32,526 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 9ad934b32fe540cf4771712205d429e0#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:32,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/d313884483b94fe7a1bb86ce8885b5d5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/00923e89d6554f8ab0da8dbda78e1147, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/e9c479f4467b42ab8ba58ebc70ea85e4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/5886455ea0df4ff7b3abb61d6b033be8, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/a4ae6d40736a48f9bb43c65b8475dca0] to archive 2023-11-18 00:55:32,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:32,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/d313884483b94fe7a1bb86ce8885b5d5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/d313884483b94fe7a1bb86ce8885b5d5 2023-11-18 00:55:32,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/00923e89d6554f8ab0da8dbda78e1147 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/00923e89d6554f8ab0da8dbda78e1147 2023-11-18 00:55:32,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/e9c479f4467b42ab8ba58ebc70ea85e4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/e9c479f4467b42ab8ba58ebc70ea85e4 2023-11-18 00:55:32,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/5886455ea0df4ff7b3abb61d6b033be8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/5886455ea0df4ff7b3abb61d6b033be8 2023-11-18 00:55:32,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/a4ae6d40736a48f9bb43c65b8475dca0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/a4ae6d40736a48f9bb43c65b8475dca0 2023-11-18 00:55:32,934 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231118044fb10ba4d948079fd4937a3dfd3fe3_del 2023-11-18 00:55:32,934 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118044fb10ba4d948079fd4937a3dfd3fe3_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231118044fb10ba4d948079fd4937a3dfd3fe3_del 2023-11-18 00:55:33,748 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e20e4ddecf924fa58cd0bbf0a0fcc799 2023-11-18 00:55:33,749 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/.tmp/family2/e20e4ddecf924fa58cd0bbf0a0fcc799 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/e20e4ddecf924fa58cd0bbf0a0fcc799 2023-11-18 00:55:33,752 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e20e4ddecf924fa58cd0bbf0a0fcc799 2023-11-18 00:55:33,753 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9ad934b32fe540cf4771712205d429e0/family2 of 9ad934b32fe540cf4771712205d429e0 into e20e4ddecf924fa58cd0bbf0a0fcc799(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:33,753 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:33,753 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:33,753 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 4a4768ae6fe039be8e8dbafffed156f9/family1 is initiating major compaction (all files) 2023-11-18 00:55:33,753 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:33,754 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:33,754 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 4a4768ae6fe039be8e8dbafffed156f9/family1 in ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:33,754 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/ce396b297cf845c7a0d27b01ce4c2aa2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/6ad50e4779404046903b7b27a7d03f26, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/4ddbc543373242a9a313de8da5762dcc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/888e99d68b50475d96e582654c2998a4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/3acb2d11b49545f8aff56a6d4b349265] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp, totalSize=26.6 K 2023-11-18 00:55:33,755 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting ce396b297cf845c7a0d27b01ce4c2aa2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268920183 2023-11-18 00:55:33,755 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 6ad50e4779404046903b7b27a7d03f26, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268921580 2023-11-18 00:55:33,755 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 4ddbc543373242a9a313de8da5762dcc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268923389 2023-11-18 00:55:33,756 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 888e99d68b50475d96e582654c2998a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268925175 2023-11-18 00:55:33,756 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 3acb2d11b49545f8aff56a6d4b349265, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:55:33,763 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 4a4768ae6fe039be8e8dbafffed156f9#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:33,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/0b39944fef4449e390980f3970ae800b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/d50b8938f56c4c1092cdf7d181c38961, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7a1fd7bd0dad4ebb99b1b9b4459c16d6, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/bc5fb5eed909405c887bda32c77946dd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7e2144b1eb5f46d3b007e0f04d34398e] to archive 2023-11-18 00:55:33,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:33,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/0b39944fef4449e390980f3970ae800b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/0b39944fef4449e390980f3970ae800b 2023-11-18 00:55:33,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/d50b8938f56c4c1092cdf7d181c38961 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/d50b8938f56c4c1092cdf7d181c38961 2023-11-18 00:55:33,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7a1fd7bd0dad4ebb99b1b9b4459c16d6 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7a1fd7bd0dad4ebb99b1b9b4459c16d6 2023-11-18 00:55:33,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/bc5fb5eed909405c887bda32c77946dd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/bc5fb5eed909405c887bda32c77946dd 2023-11-18 00:55:33,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7e2144b1eb5f46d3b007e0f04d34398e to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family2/7e2144b1eb5f46d3b007e0f04d34398e 2023-11-18 00:55:34,175 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118c0727a71e101461b86ed34740de24a55_del 2023-11-18 00:55:34,175 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118c0727a71e101461b86ed34740de24a55_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231118c0727a71e101461b86ed34740de24a55_del 2023-11-18 00:55:34,994 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2ebc7d58d404d70993e038251ac749a 2023-11-18 00:55:34,995 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family1/c2ebc7d58d404d70993e038251ac749a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/c2ebc7d58d404d70993e038251ac749a 2023-11-18 00:55:34,998 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2ebc7d58d404d70993e038251ac749a 2023-11-18 00:55:34,999 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4a4768ae6fe039be8e8dbafffed156f9/family1 of 4a4768ae6fe039be8e8dbafffed156f9 into c2ebc7d58d404d70993e038251ac749a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:55:34,999 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:34,999 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:35,000 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 4a4768ae6fe039be8e8dbafffed156f9/family2 is initiating major compaction (all files) 2023-11-18 00:55:35,000 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:35,000 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:35,000 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 4a4768ae6fe039be8e8dbafffed156f9/family2 in ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:55:35,000 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/3e3c9b347dc941558490566a64043f4a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/80dd1f9c529843c59e8dcf415027b302, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/d672b6028c21433e8b77f0d7c9e5c02f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/88790ad655d74298ab094ee4639f852a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/83e83f58919a4493b8095b7d3208bd14] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp, totalSize=25.3 K 2023-11-18 00:55:35,000 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 3e3c9b347dc941558490566a64043f4a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268920183 2023-11-18 00:55:35,001 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 80dd1f9c529843c59e8dcf415027b302, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268921580 2023-11-18 00:55:35,001 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting d672b6028c21433e8b77f0d7c9e5c02f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268923389 2023-11-18 00:55:35,001 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 88790ad655d74298ab094ee4639f852a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268925175 2023-11-18 00:55:35,002 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 83e83f58919a4493b8095b7d3208bd14, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:55:35,010 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 4a4768ae6fe039be8e8dbafffed156f9#family2#compaction#155 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:35,016 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311181bf3ecc7dea44d98a8694cdad8c279dc_del 2023-11-18 00:55:35,016 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311181bf3ecc7dea44d98a8694cdad8c279dc_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311181bf3ecc7dea44d98a8694cdad8c279dc_del 2023-11-18 00:55:35,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/ce396b297cf845c7a0d27b01ce4c2aa2, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/6ad50e4779404046903b7b27a7d03f26, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/4ddbc543373242a9a313de8da5762dcc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/888e99d68b50475d96e582654c2998a4, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/3acb2d11b49545f8aff56a6d4b349265] to archive 2023-11-18 00:55:35,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:35,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/ce396b297cf845c7a0d27b01ce4c2aa2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/ce396b297cf845c7a0d27b01ce4c2aa2 2023-11-18 00:55:35,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/6ad50e4779404046903b7b27a7d03f26 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/6ad50e4779404046903b7b27a7d03f26 2023-11-18 00:55:35,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/4ddbc543373242a9a313de8da5762dcc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/4ddbc543373242a9a313de8da5762dcc 2023-11-18 00:55:35,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/888e99d68b50475d96e582654c2998a4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/888e99d68b50475d96e582654c2998a4 2023-11-18 00:55:35,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/3acb2d11b49545f8aff56a6d4b349265 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/3acb2d11b49545f8aff56a6d4b349265 2023-11-18 00:55:35,432 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04959cb1844c400dbf2137cc8c1718db 2023-11-18 00:55:35,433 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/.tmp/family2/04959cb1844c400dbf2137cc8c1718db as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/04959cb1844c400dbf2137cc8c1718db 2023-11-18 00:55:35,437 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04959cb1844c400dbf2137cc8c1718db 2023-11-18 00:55:35,438 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4a4768ae6fe039be8e8dbafffed156f9/family2 of 4a4768ae6fe039be8e8dbafffed156f9 into 04959cb1844c400dbf2137cc8c1718db(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:35,438 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:35,441 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:35,444 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:35,448 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:35,448 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:35,453 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 00:55:35,465 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-18 00:55:35,468 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118c0727a71e101461b86ed34740de24a55_del 2023-11-18 00:55:35,470 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311184a7d994fbaa24046b3cd41b4a0d1ffaa_del 2023-11-18 00:55:35,473 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311188943d8e2c178454e9459e92212ed8f2c_del 2023-11-18 00:55:35,474 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-18 00:55:35,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/3e3c9b347dc941558490566a64043f4a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/80dd1f9c529843c59e8dcf415027b302, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/d672b6028c21433e8b77f0d7c9e5c02f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/88790ad655d74298ab094ee4639f852a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/83e83f58919a4493b8095b7d3208bd14] to archive 2023-11-18 00:55:35,475 DEBUG [Listener at localhost/41175] zookeeper.ReadOnlyZKClient(139): Connect 0x5ef36be8 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:55:35,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:35,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/3e3c9b347dc941558490566a64043f4a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/3e3c9b347dc941558490566a64043f4a 2023-11-18 00:55:35,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/80dd1f9c529843c59e8dcf415027b302 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/80dd1f9c529843c59e8dcf415027b302 2023-11-18 00:55:35,481 DEBUG [Listener at localhost/41175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25e5ef93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:55:35,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/d672b6028c21433e8b77f0d7c9e5c02f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/d672b6028c21433e8b77f0d7c9e5c02f 2023-11-18 00:55:35,483 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 00:55:35,483 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 00:55:35,483 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 00:55:35,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/88790ad655d74298ab094ee4639f852a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/88790ad655d74298ab094ee4639f852a 2023-11-18 00:55:35,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/83e83f58919a4493b8095b7d3208bd14 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family2/83e83f58919a4493b8095b7d3208bd14 2023-11-18 00:55:35,921 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311187b1c2aa8844e4937ae359883dd7e36a1 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311187b1c2aa8844e4937ae359883dd7e36a1 2023-11-18 00:55:35,922 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 00:55:35,941 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:55:35,944 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:55:35,950 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:55:35,955 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:55:35,967 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-18 00:55:35,968 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23}] 2023-11-18 00:55:35,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23 for inclusion in f1e151a6eb43f2e0c44c3327d04ea7ac/family1 2023-11-18 00:55:35,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-18 00:55:35,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 00:55:35,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:55:35,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__lf9vrpssl9bnj6bpop1tkvot823kkbi3fai2trbuovoltimo85nuvs4bgcd6esee/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23 2023-11-18 00:55:35,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__lf9vrpssl9bnj6bpop1tkvot823kkbi3fai2trbuovoltimo85nuvs4bgcd6esee/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8b323bc9c26a43de87f0645a693851cd_SeqId_28_ 2023-11-18 00:55:35,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__lf9vrpssl9bnj6bpop1tkvot823kkbi3fai2trbuovoltimo85nuvs4bgcd6esee/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23 into f1e151a6eb43f2e0c44c3327d04ea7ac/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8b323bc9c26a43de87f0645a693851cd_SeqId_28_ - updating store file list. 2023-11-18 00:55:35,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8b323bc9c26a43de87f0645a693851cd_SeqId_28_ into f1e151a6eb43f2e0c44c3327d04ea7ac/family1 2023-11-18 00:55:35,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__lf9vrpssl9bnj6bpop1tkvot823kkbi3fai2trbuovoltimo85nuvs4bgcd6esee/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23 into f1e151a6eb43f2e0c44c3327d04ea7ac/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/family1/8b323bc9c26a43de87f0645a693851cd_SeqId_28_) 2023-11-18 00:55:35,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__lf9vrpssl9bnj6bpop1tkvot823kkbi3fai2trbuovoltimo85nuvs4bgcd6esee/family1/ad2d9b50aa9c49bfb4bc9513a6d68c23 2023-11-18 00:55:35,985 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 00:55:35,985 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:35,987 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118bb9ad83d24d7466dbe4bdac35b959a84 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118bb9ad83d24d7466dbe4bdac35b959a84 2023-11-18 00:55:35,987 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-18 00:55:35,987 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 00:55:35,987 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 00:55:36,319 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118dc9d6dd3a24b459aacd4e344a66af739 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118dc9d6dd3a24b459aacd4e344a66af739 2023-11-18 00:55:36,320 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311183ec31deed64d420d9ebee4fd0de952ff to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311183ec31deed64d420d9ebee4fd0de952ff 2023-11-18 00:55:36,320 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 00:55:36,321 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 00:55:36,343 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118/family1/f9b1a843c84e481687769ca0c5962786 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-18 00:55:36,344 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118/family1/f9b1a843c84e481687769ca0c5962786}] 2023-11-18 00:55:36,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118/family1/f9b1a843c84e481687769ca0c5962786 for inclusion in 9ad934b32fe540cf4771712205d429e0/family1 2023-11-18 00:55:36,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-18 00:55:36,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-18 00:55:36,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:55:36,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118/family1/f9b1a843c84e481687769ca0c5962786 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__tur8549n36f4asscckcphasho2gpu6mog3lbeq2kqstj38nj9ukriv765131glg1/family1/f9b1a843c84e481687769ca0c5962786 2023-11-18 00:55:36,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__tur8549n36f4asscckcphasho2gpu6mog3lbeq2kqstj38nj9ukriv765131glg1/family1/f9b1a843c84e481687769ca0c5962786 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/7ea575d4e2fe4ffeb8f6aea21e22b947_SeqId_28_ 2023-11-18 00:55:36,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__tur8549n36f4asscckcphasho2gpu6mog3lbeq2kqstj38nj9ukriv765131glg1/family1/f9b1a843c84e481687769ca0c5962786 into 9ad934b32fe540cf4771712205d429e0/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/7ea575d4e2fe4ffeb8f6aea21e22b947_SeqId_28_ - updating store file list. 2023-11-18 00:55:36,354 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/family1/3db89135f958475996c54e4f2bcc90cf first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-18 00:55:36,354 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/family1/3db89135f958475996c54e4f2bcc90cf}] 2023-11-18 00:55:36,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/family1/3db89135f958475996c54e4f2bcc90cf for inclusion in 4a4768ae6fe039be8e8dbafffed156f9/family1 2023-11-18 00:55:36,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/7ea575d4e2fe4ffeb8f6aea21e22b947_SeqId_28_ into 9ad934b32fe540cf4771712205d429e0/family1 2023-11-18 00:55:36,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__tur8549n36f4asscckcphasho2gpu6mog3lbeq2kqstj38nj9ukriv765131glg1/family1/f9b1a843c84e481687769ca0c5962786 into 9ad934b32fe540cf4771712205d429e0/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/family1/7ea575d4e2fe4ffeb8f6aea21e22b947_SeqId_28_) 2023-11-18 00:55:36,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__tur8549n36f4asscckcphasho2gpu6mog3lbeq2kqstj38nj9ukriv765131glg1/family1/f9b1a843c84e481687769ca0c5962786 2023-11-18 00:55:36,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-18 00:55:36,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last=1 2023-11-18 00:55:36,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:55:36,359 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 00:55:36,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/family1/3db89135f958475996c54e4f2bcc90cf to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__9mt7bobtmu1fmetvoatqdnulbirlr0aqfdeh1pictqhrvps6kr5m27paq2bi49m7/family1/3db89135f958475996c54e4f2bcc90cf 2023-11-18 00:55:36,360 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:36,361 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311184b753c600cd347b88817b0dd4d383f38 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311184b753c600cd347b88817b0dd4d383f38 2023-11-18 00:55:36,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__9mt7bobtmu1fmetvoatqdnulbirlr0aqfdeh1pictqhrvps6kr5m27paq2bi49m7/family1/3db89135f958475996c54e4f2bcc90cf as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/caff954a24264668a9de1f8e797426af_SeqId_28_ 2023-11-18 00:55:36,361 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-18 00:55:36,361 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118' 2023-11-18 00:55:36,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__9mt7bobtmu1fmetvoatqdnulbirlr0aqfdeh1pictqhrvps6kr5m27paq2bi49m7/family1/3db89135f958475996c54e4f2bcc90cf into 4a4768ae6fe039be8e8dbafffed156f9/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/caff954a24264668a9de1f8e797426af_SeqId_28_ - updating store file list. 2023-11-18 00:55:36,362 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 00:55:36,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/caff954a24264668a9de1f8e797426af_SeqId_28_ into 4a4768ae6fe039be8e8dbafffed156f9/family1 2023-11-18 00:55:36,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__9mt7bobtmu1fmetvoatqdnulbirlr0aqfdeh1pictqhrvps6kr5m27paq2bi49m7/family1/3db89135f958475996c54e4f2bcc90cf into 4a4768ae6fe039be8e8dbafffed156f9/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/family1/caff954a24264668a9de1f8e797426af_SeqId_28_) 2023-11-18 00:55:36,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__ns_testMinorCompaction__9mt7bobtmu1fmetvoatqdnulbirlr0aqfdeh1pictqhrvps6kr5m27paq2bi49m7/family1/3db89135f958475996c54e4f2bcc90cf 2023-11-18 00:55:36,366 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 00:55:36,367 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:36,368 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231118afe3e038c121439db080207d94f44f50 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231118afe3e038c121439db080207d94f44f50 2023-11-18 00:55:36,368 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-18 00:55:36,368 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 00:55:36,368 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 00:55:36,368 INFO [Listener at localhost/41175] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-18 00:55:36,370 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:36,372 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:36,374 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:36,375 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:36,390 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 281), OpenFileDescriptor=647 (was 759), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=143 (was 152), ProcessCount=167 (was 167), AvailableMemoryMB=9677 (was 9569) - AvailableMemoryMB LEAK? - 2023-11-18 00:55:36,401 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=143, ProcessCount=167, AvailableMemoryMB=9677 2023-11-18 00:55:36,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 00:55:36,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:36,405 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:55:36,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-18 00:55:36,405 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:55:36,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 00:55:36,406 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:36,407 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f empty. 2023-11-18 00:55:36,407 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:36,407 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-18 00:55:36,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 00:55:36,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 00:55:36,814 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-18 00:55:36,815 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 02b1e7a1949f099eff40c89fdf701b6f, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:55:37,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 00:55:37,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:37,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 02b1e7a1949f099eff40c89fdf701b6f, disabling compactions & flushes 2023-11-18 00:55:37,221 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:37,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:37,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. after waiting 0 ms 2023-11-18 00:55:37,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:37,221 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:37,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:37,223 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:55:37,224 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700268937224"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268937224"}]},"ts":"1700268937224"} 2023-11-18 00:55:37,225 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 00:55:37,226 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:55:37,226 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268937226"}]},"ts":"1700268937226"} 2023-11-18 00:55:37,227 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-18 00:55:37,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=02b1e7a1949f099eff40c89fdf701b6f, ASSIGN}] 2023-11-18 00:55:37,232 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=02b1e7a1949f099eff40c89fdf701b6f, ASSIGN 2023-11-18 00:55:37,232 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=02b1e7a1949f099eff40c89fdf701b6f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:55:37,383 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=02b1e7a1949f099eff40c89fdf701b6f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:37,383 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700268937383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268937383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268937383"}]},"ts":"1700268937383"} 2023-11-18 00:55:37,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 02b1e7a1949f099eff40c89fdf701b6f, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:37,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 00:55:37,536 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:37,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:37,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02b1e7a1949f099eff40c89fdf701b6f, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f.', STARTKEY => '', ENDKEY => ''} 2023-11-18 00:55:37,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:37,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:37,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:37,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:37,540 INFO [StoreOpener-02b1e7a1949f099eff40c89fdf701b6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:37,542 DEBUG [StoreOpener-02b1e7a1949f099eff40c89fdf701b6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1 2023-11-18 00:55:37,542 DEBUG [StoreOpener-02b1e7a1949f099eff40c89fdf701b6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1 2023-11-18 00:55:37,542 INFO [StoreOpener-02b1e7a1949f099eff40c89fdf701b6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02b1e7a1949f099eff40c89fdf701b6f columnFamilyName family1 2023-11-18 00:55:37,543 INFO [StoreOpener-02b1e7a1949f099eff40c89fdf701b6f-1] regionserver.HStore(310): Store=02b1e7a1949f099eff40c89fdf701b6f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:37,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:37,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:37,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:55:37,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:55:37,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 02b1e7a1949f099eff40c89fdf701b6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70560200, jitterRate=0.051428914070129395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 00:55:37,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:37,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f., pid=114, masterSystemTime=1700268937536 2023-11-18 00:55:37,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:37,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:37,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=02b1e7a1949f099eff40c89fdf701b6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:37,551 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700268937550"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268937550"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268937550"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268937550"}]},"ts":"1700268937550"} 2023-11-18 00:55:37,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-18 00:55:37,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 02b1e7a1949f099eff40c89fdf701b6f, server=jenkins-hbase4.apache.org,46287,1700268799711 in 167 msec 2023-11-18 00:55:37,554 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-18 00:55:37,554 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=02b1e7a1949f099eff40c89fdf701b6f, ASSIGN in 323 msec 2023-11-18 00:55:37,555 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:55:37,555 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268937555"}]},"ts":"1700268937555"} 2023-11-18 00:55:37,556 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-18 00:55:37,558 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:55:37,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1550 sec 2023-11-18 00:55:38,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 00:55:38,511 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-18 00:55:38,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:38,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:38,531 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:38,531 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:38,531 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:38,531 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:38,531 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:38,532 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:38,534 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:38,534 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:38,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:38,534 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:38,534 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:38,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:38,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:38,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:38,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:38,535 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:38,535 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:38,535 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:38,535 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:38,535 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:38,536 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:38,536 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:38,536 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 00:55:38,957 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a2bff3e457bf46eaba8513f17e04fc5b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a2bff3e457bf46eaba8513f17e04fc5b 2023-11-18 00:55:39,361 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/8a27c340b00e4900a23da5fbabb0c802 2023-11-18 00:55:39,365 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/8a27c340b00e4900a23da5fbabb0c802 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/8a27c340b00e4900a23da5fbabb0c802 2023-11-18 00:55:39,368 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/8a27c340b00e4900a23da5fbabb0c802, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-18 00:55:39,369 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 833ms, sequenceid=5, compaction requested=false 2023-11-18 00:55:39,369 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:39,369 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:39,369 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:39,369 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:39,369 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:39,369 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,369 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:39,369 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:39,376 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,376 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:39,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:39,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:39,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:39,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:39,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:39,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ab3433a[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:39,378 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:39,378 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,379 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,379 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:39,379 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:39,379 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:39,379 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,380 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:39,381 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:39,381 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,381 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:39,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:39,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:39,381 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:39,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:39,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:39,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:39,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:39,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:39,383 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:39,383 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:39,383 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:39,383 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,383 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:39,386 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,386 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:39,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:39,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,386 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:39,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:39,387 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:39,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:39,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:39,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,388 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:39,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,390 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,390 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,390 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:39,390 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:39,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:39,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:39,390 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:39,390 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,390 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:39,391 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:39,391 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:39,391 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:39,391 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,391 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:39,491 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:39,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:39,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:39,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:39,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,497 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:39,497 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:39,497 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:39,497 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:39,497 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,497 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,499 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,499 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:39,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:39,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:39,499 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:39,499 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:39,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,500 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,500 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:39,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:39,500 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:39,500 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:39,500 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:39,501 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 00:55:39,912 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ed18b23b6e27474fa2ba72acad7a849a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128ed18b23b6e27474fa2ba72acad7a849a 2023-11-18 00:55:40,317 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/afbb1bfa398e443f8032b8c1c490c314 2023-11-18 00:55:40,320 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/afbb1bfa398e443f8032b8c1c490c314 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/afbb1bfa398e443f8032b8c1c490c314 2023-11-18 00:55:40,324 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/afbb1bfa398e443f8032b8c1c490c314, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 00:55:40,325 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 824ms, sequenceid=9, compaction requested=false 2023-11-18 00:55:40,325 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:40,325 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:40,325 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:40,328 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,328 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:40,328 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,328 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:40,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:40,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c8bc11[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:40,330 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:40,330 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,332 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,332 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:40,332 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:40,332 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:40,332 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,332 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:40,334 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:40,334 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,334 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:40,334 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:40,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:40,336 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:40,336 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:40,336 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:40,336 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,336 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:40,338 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,338 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,338 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:40,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:40,339 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,340 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:40,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,342 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,342 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,342 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:40,342 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:40,342 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:40,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:40,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:55:40,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:40,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:40,342 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,342 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:40,342 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:40,343 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,343 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,343 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:40,343 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:40,443 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:40,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:40,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:40,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:40,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,449 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:40,449 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:40,449 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:40,449 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:40,449 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,449 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,451 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,451 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:40,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:40,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:40,452 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:40,452 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:40,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:40,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,452 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,452 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:40,453 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:40,453 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:40,453 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:40,453 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:40,453 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:40,453 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:40,453 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:40,453 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:40,453 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:55:40,865 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013a589633762e43aab4a73e7dca606f06 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013a589633762e43aab4a73e7dca606f06 2023-11-18 00:55:41,271 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/7674afcc9ce2469790398644fc02f685 2023-11-18 00:55:41,275 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/7674afcc9ce2469790398644fc02f685 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7674afcc9ce2469790398644fc02f685 2023-11-18 00:55:41,278 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7674afcc9ce2469790398644fc02f685, entries=1, sequenceid=13, filesize=4.9 K 2023-11-18 00:55:41,279 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 826ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:41,279 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:41,279 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:41,279 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:41,281 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,281 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:41,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:41,281 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,281 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:41,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:41,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:41,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:41,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c00d72e[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:41,282 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:41,282 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,284 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,284 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:41,284 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,284 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:41,284 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:41,284 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:41,285 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:41,285 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:41,285 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,285 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:41,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:41,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:41,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:41,288 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:41,288 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:41,288 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:41,288 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,288 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:41,290 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,290 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:41,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:41,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,290 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:41,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:41,291 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,292 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,296 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,296 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:41,296 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,296 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:41,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:55:41,296 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:41,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:41,296 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:41,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:41,297 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:41,297 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,297 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:41,297 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:41,297 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,297 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:41,397 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:41,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:41,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:41,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:41,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,403 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:41,403 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:41,403 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:41,403 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:41,404 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,404 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,405 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,405 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:41,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:41,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:41,405 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:41,405 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:41,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:41,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,406 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,406 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:41,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:41,406 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:41,407 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:41,407 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:41,407 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:41,407 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:55:41,818 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053d8c91f9c9984ddebb9b7c3ea514d651 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053d8c91f9c9984ddebb9b7c3ea514d651 2023-11-18 00:55:42,223 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/7c5a6700a4a642afa41035ffd3f80e7f 2023-11-18 00:55:42,226 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/7c5a6700a4a642afa41035ffd3f80e7f as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7c5a6700a4a642afa41035ffd3f80e7f 2023-11-18 00:55:42,230 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7c5a6700a4a642afa41035ffd3f80e7f, entries=1, sequenceid=17, filesize=4.9 K 2023-11-18 00:55:42,231 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 824ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:42,231 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:42,231 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:42,231 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:42,231 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:42,231 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,231 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:42,231 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:42,234 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,234 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:42,234 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,234 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:42,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:42,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19ed5647[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:42,236 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:42,236 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,237 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,237 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:42,237 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:42,237 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:42,237 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,237 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:42,238 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,238 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:42,238 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:42,238 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:42,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:42,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:42,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:42,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:42,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:42,241 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:42,241 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:42,241 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:42,241 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,241 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:42,242 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,242 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:42,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,242 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:42,243 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,244 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,247 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,247 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:42,247 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:42,248 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:42,247 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:42,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:42,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:42,247 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,248 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,248 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,248 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,248 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,248 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:42,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:42,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:55:42,248 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:42,348 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:42,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:42,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:42,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:42,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,354 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:42,354 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:42,354 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:42,354 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:42,355 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,355 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,356 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:42,356 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:42,356 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:42,356 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:42,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:42,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,357 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,357 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:42,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:42,357 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:42,357 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:42,357 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:42,358 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:42,358 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:42,358 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:42,358 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:42,358 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:55:42,768 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122812c7fdde3ea04e678841ce0210d3f508 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122812c7fdde3ea04e678841ce0210d3f508 2023-11-18 00:55:43,077 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:55:43,174 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/c81e2d29054d4c20be50296480f83eed 2023-11-18 00:55:43,178 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/c81e2d29054d4c20be50296480f83eed as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c81e2d29054d4c20be50296480f83eed 2023-11-18 00:55:43,181 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c81e2d29054d4c20be50296480f83eed, entries=1, sequenceid=21, filesize=4.9 K 2023-11-18 00:55:43,182 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 824ms, sequenceid=21, compaction requested=true 2023-11-18 00:55:43,182 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:43,182 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:43,182 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:43,182 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:43,182 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,182 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:43,182 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:43,184 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:43,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:43,184 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:43,184 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,184 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:43,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:43,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:43,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:43,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9d76cd3[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:43,186 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:43,186 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,187 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,187 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:43,187 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:43,187 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:43,187 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,187 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:43,190 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,190 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:43,190 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:43,190 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:43,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:43,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:43,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:43,192 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:43,192 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:43,192 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:43,192 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,192 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:43,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:43,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,194 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:43,194 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:43,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,195 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:43,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:43,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,198 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:43,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:43,198 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:43,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:43,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:43,299 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:43,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:43,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:43,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:43,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,304 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:43,305 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:43,305 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:43,305 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:43,305 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,305 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,306 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,306 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:43,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:43,307 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:43,307 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,308 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:43,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:43,308 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:43,308 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:43,308 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:55:43,719 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f209310ab71b440fb9508e026cbf02fe to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f209310ab71b440fb9508e026cbf02fe 2023-11-18 00:55:44,125 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/c04cc8907f334640bd83f2b947628430 2023-11-18 00:55:44,128 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/c04cc8907f334640bd83f2b947628430 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c04cc8907f334640bd83f2b947628430 2023-11-18 00:55:44,131 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c04cc8907f334640bd83f2b947628430, entries=1, sequenceid=25, filesize=4.9 K 2023-11-18 00:55:44,132 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 824ms, sequenceid=25, compaction requested=true 2023-11-18 00:55:44,132 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:44,132 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,135 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fb961cc[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:44,136 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:44,136 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,138 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:44,138 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,138 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:44,142 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:44,142 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:44,142 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,142 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:44,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:44,144 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:44,144 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:44,144 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:44,144 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,144 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:44,147 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,147 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:44,147 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:44,147 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,149 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:44,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,151 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:44,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:44,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:44,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:44,151 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:44,152 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:44,252 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:44,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:44,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:44,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:44,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,257 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:44,257 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:44,258 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:44,258 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:44,258 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,258 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,259 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,259 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:44,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:44,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:44,260 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,260 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,261 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:44,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:44,261 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:44,261 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:44,261 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:55:44,672 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019b5d40e84c3b4dfd8624e941140f28ab to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019b5d40e84c3b4dfd8624e941140f28ab 2023-11-18 00:55:44,677 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/2b4b527f89ce46dbb88b19d5e90ef2cd 2023-11-18 00:55:44,680 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/2b4b527f89ce46dbb88b19d5e90ef2cd as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/2b4b527f89ce46dbb88b19d5e90ef2cd 2023-11-18 00:55:44,683 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/2b4b527f89ce46dbb88b19d5e90ef2cd, entries=1, sequenceid=29, filesize=4.9 K 2023-11-18 00:55:44,684 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 423ms, sequenceid=29, compaction requested=true 2023-11-18 00:55:44,684 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:44,684 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:44,684 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:44,684 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:44,684 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,684 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:44,684 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:44,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,686 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:44,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:44,686 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:44,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:44,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:44,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@559a66b2[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:44,687 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:44,688 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,689 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,689 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:44,690 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:44,690 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,690 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:44,690 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:44,691 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:44,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:44,691 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:44,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:44,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:44,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:44,693 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:44,693 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:44,693 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:44,693 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,693 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:44,695 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,695 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:44,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,695 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:44,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:44,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:44,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:44,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:44,696 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:44,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,697 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:44,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:44,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:55:44,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:44,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:44,699 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:44,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:44,700 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,699 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:44,700 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:44,700 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:44,700 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:44,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:44,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:44,800 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:44,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:44,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:44,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,806 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:44,806 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:44,806 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:44,806 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:44,807 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,807 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,809 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,809 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:44,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:44,809 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:44,809 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:44,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,810 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,810 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:44,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:44,810 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:44,810 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:44,811 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:55:45,221 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f58e5e0ccf0846e19d8536359d676b4f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103f58e5e0ccf0846e19d8536359d676b4f 2023-11-18 00:55:45,626 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/6d95557aaefe4dd7990c4db8b4e9c92b 2023-11-18 00:55:45,630 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/6d95557aaefe4dd7990c4db8b4e9c92b as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6d95557aaefe4dd7990c4db8b4e9c92b 2023-11-18 00:55:45,633 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6d95557aaefe4dd7990c4db8b4e9c92b, entries=1, sequenceid=33, filesize=4.9 K 2023-11-18 00:55:45,634 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 823ms, sequenceid=33, compaction requested=true 2023-11-18 00:55:45,634 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:45,634 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:45,634 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:45,634 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:45,634 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,634 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:45,634 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:45,636 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,636 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:45,636 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,636 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:45,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:45,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b65d28[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:45,638 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:45,638 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,639 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,639 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:45,639 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:45,639 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:45,639 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,639 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:45,641 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:45,641 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,641 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:45,641 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:45,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:45,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:45,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:45,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:45,643 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:45,643 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:45,643 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:45,643 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,643 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:45,645 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,645 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,645 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:45,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:45,646 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,647 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,650 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:45,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:45,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,650 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:45,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:45,651 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:45,651 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:45,751 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:45,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:45,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:45,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:45,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,758 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:45,758 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:45,758 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:45,758 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:45,758 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,758 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,759 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,760 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:45,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:45,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:45,760 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:45,760 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:45,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,761 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,761 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:45,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:45,762 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:45,762 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:45,762 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:55:46,172 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073cf89bf9033e42e996c0fce365ef8794 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509073cf89bf9033e42e996c0fce365ef8794 2023-11-18 00:55:46,577 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/79f3f745f7854b7c852240959afe0468 2023-11-18 00:55:46,582 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/79f3f745f7854b7c852240959afe0468 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/79f3f745f7854b7c852240959afe0468 2023-11-18 00:55:46,585 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/79f3f745f7854b7c852240959afe0468, entries=1, sequenceid=37, filesize=4.9 K 2023-11-18 00:55:46,586 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 824ms, sequenceid=37, compaction requested=true 2023-11-18 00:55:46,586 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:46,586 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:46,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:46,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:46,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:46,586 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,592 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:46,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:46,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14351cd9[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:46,593 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:46,593 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,594 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:46,595 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,595 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:46,596 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:46,596 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:46,596 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:46,596 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:46,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:46,598 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:46,598 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:46,598 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:46,598 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,598 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:46,600 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,600 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,600 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:46,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:46,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:46,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:46,601 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,602 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,605 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,605 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,605 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,605 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:46,605 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 00:55:46,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:46,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:46,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:46,606 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:46,606 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:46,606 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:46,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:46,606 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,606 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:46,606 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:46,606 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,706 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:46,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:46,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:46,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:46,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,712 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 00:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 00:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,712 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,714 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,714 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:46,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:46,714 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:46,714 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,715 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 00:55:46,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:46,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 00:55:46,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:46,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 00:55:46,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 00:55:46,715 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:46,715 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:46,715 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. started... 2023-11-18 00:55:46,716 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 02b1e7a1949f099eff40c89fdf701b6f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 00:55:47,126 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120398e4177aba74876aaf852ff6c5d2515 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120398e4177aba74876aaf852ff6c5d2515 2023-11-18 00:55:47,531 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/e0955f3c044540c5b89202a95673f973 2023-11-18 00:55:47,535 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/e0955f3c044540c5b89202a95673f973 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/e0955f3c044540c5b89202a95673f973 2023-11-18 00:55:47,538 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/e0955f3c044540c5b89202a95673f973, entries=1, sequenceid=41, filesize=4.9 K 2023-11-18 00:55:47,539 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 02b1e7a1949f099eff40c89fdf701b6f in 823ms, sequenceid=41, compaction requested=true 2023-11-18 00:55:47,539 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:47,539 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 00:55:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 00:55:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 00:55:47,539 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 00:55:47,541 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:47,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:47,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:47,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:47,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 00:55:47,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1086a892[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:47,543 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 00:55:47,543 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,544 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,544 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 00:55:47,544 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 00:55:47,544 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:47,545 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,545 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:47,547 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 00:55:47,547 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,547 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:47,547 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 00:55:47,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:47,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:47,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:47,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:47,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 00:55:47,550 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 00:55:47,550 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:47,550 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:47,550 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,550 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:47,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,551 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:47,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:47,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:47,552 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:47,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,553 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:47,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:47,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 00:55:47,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:47,556 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:47,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:47,556 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:47,657 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:47,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:47,659 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-18 00:55:47,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:55:47,661 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:55:47,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:55:47,661 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269547661 2023-11-18 00:55:47,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 00:55:47,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-18 00:55:47,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:55:47,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x6b6ebe81 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:55:47,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@488c2bdc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:55:47,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:55:48,095 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b628a34388b541eabc5243fee67b5cec to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b628a34388b541eabc5243fee67b5cec 2023-11-18 00:55:48,097 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:55:48,109 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:55:48,111 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:55:48,116 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:55:48,117 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:55:48,124 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/12b0f3d0e72c46fb89a102203584111f first=Optional[r5] last=Optional[r6] 2023-11-18 00:55:48,124 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/12b0f3d0e72c46fb89a102203584111f}] 2023-11-18 00:55:48,133 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/12b0f3d0e72c46fb89a102203584111f for inclusion in 02b1e7a1949f099eff40c89fdf701b6f/family1 2023-11-18 00:55:48,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-18 00:55:48,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:55:48,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:48,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/12b0f3d0e72c46fb89a102203584111f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e3p30hthd6d076dc45fovcl7nnudfknmvdgijuob00entkuforeq8uqj4j3qskeu/family1/12b0f3d0e72c46fb89a102203584111f 2023-11-18 00:55:48,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e3p30hthd6d076dc45fovcl7nnudfknmvdgijuob00entkuforeq8uqj4j3qskeu/family1/12b0f3d0e72c46fb89a102203584111f as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c47298a0237f48baa94420a0f5e960ae_SeqId_44_ 2023-11-18 00:55:48,139 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e3p30hthd6d076dc45fovcl7nnudfknmvdgijuob00entkuforeq8uqj4j3qskeu/family1/12b0f3d0e72c46fb89a102203584111f into 02b1e7a1949f099eff40c89fdf701b6f/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c47298a0237f48baa94420a0f5e960ae_SeqId_44_ - updating store file list. 2023-11-18 00:55:48,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c47298a0237f48baa94420a0f5e960ae_SeqId_44_ into 02b1e7a1949f099eff40c89fdf701b6f/family1 2023-11-18 00:55:48,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e3p30hthd6d076dc45fovcl7nnudfknmvdgijuob00entkuforeq8uqj4j3qskeu/family1/12b0f3d0e72c46fb89a102203584111f into 02b1e7a1949f099eff40c89fdf701b6f/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c47298a0237f48baa94420a0f5e960ae_SeqId_44_) 2023-11-18 00:55:48,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e3p30hthd6d076dc45fovcl7nnudfknmvdgijuob00entkuforeq8uqj4j3qskeu/family1/12b0f3d0e72c46fb89a102203584111f 2023-11-18 00:55:48,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 00:55:48,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 00:55:48,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(1912): 02b1e7a1949f099eff40c89fdf701b6f/family1 is initiating minor compaction 2023-11-18 00:55:48,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f38b6a9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:48,145 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 02b1e7a1949f099eff40c89fdf701b6f/family1 in testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:48,145 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/afbb1bfa398e443f8032b8c1c490c314, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7674afcc9ce2469790398644fc02f685, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7c5a6700a4a642afa41035ffd3f80e7f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c81e2d29054d4c20be50296480f83eed, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c04cc8907f334640bd83f2b947628430, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/2b4b527f89ce46dbb88b19d5e90ef2cd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6d95557aaefe4dd7990c4db8b4e9c92b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/79f3f745f7854b7c852240959afe0468, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/e0955f3c044540c5b89202a95673f973, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c47298a0237f48baa94420a0f5e960ae_SeqId_44_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp, totalSize=49.7 K 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting afbb1bfa398e443f8032b8c1c490c314, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 7674afcc9ce2469790398644fc02f685, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 7c5a6700a4a642afa41035ffd3f80e7f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting c81e2d29054d4c20be50296480f83eed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting c04cc8907f334640bd83f2b947628430, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 2b4b527f89ce46dbb88b19d5e90ef2cd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 6d95557aaefe4dd7990c4db8b4e9c92b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 79f3f745f7854b7c852240959afe0468, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting e0955f3c044540c5b89202a95673f973, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 00:55:48,145 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting c47298a0237f48baa94420a0f5e960ae_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 00:55:48,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:55:48,148 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:48,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019b5d40e84c3b4dfd8624e941140f28ab to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019b5d40e84c3b4dfd8624e941140f28ab 2023-11-18 00:55:48,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103f58e5e0ccf0846e19d8536359d676b4f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103f58e5e0ccf0846e19d8536359d676b4f 2023-11-18 00:55:48,150 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-18 00:55:48,150 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-18 00:55:48,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:55:48,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:55:48,185 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 02b1e7a1949f099eff40c89fdf701b6f#family1#compaction#166 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:48,200 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c9f3b394f2aa4742ad7585af1e1fb9d7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c9f3b394f2aa4742ad7585af1e1fb9d7 2023-11-18 00:55:48,201 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:55:48,223 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5f724139a8034f2d8d43b60b3c70ec11 first=Optional[r1] last=Optional[r4] 2023-11-18 00:55:48,223 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5f724139a8034f2d8d43b60b3c70ec11}] 2023-11-18 00:55:48,225 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5f724139a8034f2d8d43b60b3c70ec11 for inclusion in 02b1e7a1949f099eff40c89fdf701b6f/family1 2023-11-18 00:55:48,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-18 00:55:48,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:55:48,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:48,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5f724139a8034f2d8d43b60b3c70ec11 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjsrt2cnmlp33a17rlso5p4u5epsofm781pqdc43gj5dh99oolef34kjkecsc2qt/family1/5f724139a8034f2d8d43b60b3c70ec11 2023-11-18 00:55:48,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjsrt2cnmlp33a17rlso5p4u5epsofm781pqdc43gj5dh99oolef34kjkecsc2qt/family1/5f724139a8034f2d8d43b60b3c70ec11 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_ 2023-11-18 00:55:48,230 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjsrt2cnmlp33a17rlso5p4u5epsofm781pqdc43gj5dh99oolef34kjkecsc2qt/family1/5f724139a8034f2d8d43b60b3c70ec11 into 02b1e7a1949f099eff40c89fdf701b6f/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_ - updating store file list. 2023-11-18 00:55:48,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_ into 02b1e7a1949f099eff40c89fdf701b6f/family1 2023-11-18 00:55:48,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjsrt2cnmlp33a17rlso5p4u5epsofm781pqdc43gj5dh99oolef34kjkecsc2qt/family1/5f724139a8034f2d8d43b60b3c70ec11 into 02b1e7a1949f099eff40c89fdf701b6f/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_) 2023-11-18 00:55:48,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vjsrt2cnmlp33a17rlso5p4u5epsofm781pqdc43gj5dh99oolef34kjkecsc2qt/family1/5f724139a8034f2d8d43b60b3c70ec11 2023-11-18 00:55:48,234 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:55:48,235 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:48,236 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013a589633762e43aab4a73e7dca606f06 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013a589633762e43aab4a73e7dca606f06 2023-11-18 00:55:48,237 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053d8c91f9c9984ddebb9b7c3ea514d651 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512053d8c91f9c9984ddebb9b7c3ea514d651 2023-11-18 00:55:48,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122812c7fdde3ea04e678841ce0210d3f508 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122812c7fdde3ea04e678841ce0210d3f508 2023-11-18 00:55:48,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f209310ab71b440fb9508e026cbf02fe to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f209310ab71b440fb9508e026cbf02fe 2023-11-18 00:55:48,239 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-18 00:55:48,239 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-18 00:55:48,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:55:48,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:55:49,000 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/319a77d32a33442fb8b5ab5174620763 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/319a77d32a33442fb8b5ab5174620763 2023-11-18 00:55:49,004 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 02b1e7a1949f099eff40c89fdf701b6f/family1 of 02b1e7a1949f099eff40c89fdf701b6f into 319a77d32a33442fb8b5ab5174620763(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:49,004 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:49,004 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700268948145; duration=0sec 2023-11-18 00:55:49,005 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:49,073 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130338032cdb31844938920468028241732 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130338032cdb31844938920468028241732 2023-11-18 00:55:49,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:55:49,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/afbb1bfa398e443f8032b8c1c490c314, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7674afcc9ce2469790398644fc02f685, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7c5a6700a4a642afa41035ffd3f80e7f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c81e2d29054d4c20be50296480f83eed, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c04cc8907f334640bd83f2b947628430, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/2b4b527f89ce46dbb88b19d5e90ef2cd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6d95557aaefe4dd7990c4db8b4e9c92b, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/79f3f745f7854b7c852240959afe0468, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/e0955f3c044540c5b89202a95673f973, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c47298a0237f48baa94420a0f5e960ae_SeqId_44_] to archive 2023-11-18 00:55:49,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:49,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/afbb1bfa398e443f8032b8c1c490c314 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/afbb1bfa398e443f8032b8c1c490c314 2023-11-18 00:55:49,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7674afcc9ce2469790398644fc02f685 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7674afcc9ce2469790398644fc02f685 2023-11-18 00:55:49,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7c5a6700a4a642afa41035ffd3f80e7f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/7c5a6700a4a642afa41035ffd3f80e7f 2023-11-18 00:55:49,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c81e2d29054d4c20be50296480f83eed to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c81e2d29054d4c20be50296480f83eed 2023-11-18 00:55:49,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c04cc8907f334640bd83f2b947628430 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c04cc8907f334640bd83f2b947628430 2023-11-18 00:55:49,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/2b4b527f89ce46dbb88b19d5e90ef2cd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/2b4b527f89ce46dbb88b19d5e90ef2cd 2023-11-18 00:55:49,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6d95557aaefe4dd7990c4db8b4e9c92b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6d95557aaefe4dd7990c4db8b4e9c92b 2023-11-18 00:55:49,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/79f3f745f7854b7c852240959afe0468 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/79f3f745f7854b7c852240959afe0468 2023-11-18 00:55:49,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/e0955f3c044540c5b89202a95673f973 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/e0955f3c044540c5b89202a95673f973 2023-11-18 00:55:49,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c47298a0237f48baa94420a0f5e960ae_SeqId_44_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/c47298a0237f48baa94420a0f5e960ae_SeqId_44_ 2023-11-18 00:55:49,096 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/187a0ab7ed174e80b5e784492e05b3c7 first=Optional[r00] last=Optional[r8] 2023-11-18 00:55:49,097 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/187a0ab7ed174e80b5e784492e05b3c7}] 2023-11-18 00:55:49,098 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/187a0ab7ed174e80b5e784492e05b3c7 for inclusion in 02b1e7a1949f099eff40c89fdf701b6f/family1 2023-11-18 00:55:49,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-18 00:55:49,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 00:55:49,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:49,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/187a0ab7ed174e80b5e784492e05b3c7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f8u99bb4d2btvfq3fcssn45bl85pa6ltmkrnvph6b03j0dehgssdcph3ma0prvrs/family1/187a0ab7ed174e80b5e784492e05b3c7 2023-11-18 00:55:49,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f8u99bb4d2btvfq3fcssn45bl85pa6ltmkrnvph6b03j0dehgssdcph3ma0prvrs/family1/187a0ab7ed174e80b5e784492e05b3c7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_ 2023-11-18 00:55:49,103 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f8u99bb4d2btvfq3fcssn45bl85pa6ltmkrnvph6b03j0dehgssdcph3ma0prvrs/family1/187a0ab7ed174e80b5e784492e05b3c7 into 02b1e7a1949f099eff40c89fdf701b6f/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_ - updating store file list. 2023-11-18 00:55:49,107 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_ into 02b1e7a1949f099eff40c89fdf701b6f/family1 2023-11-18 00:55:49,107 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f8u99bb4d2btvfq3fcssn45bl85pa6ltmkrnvph6b03j0dehgssdcph3ma0prvrs/family1/187a0ab7ed174e80b5e784492e05b3c7 into 02b1e7a1949f099eff40c89fdf701b6f/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_) 2023-11-18 00:55:49,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f8u99bb4d2btvfq3fcssn45bl85pa6ltmkrnvph6b03j0dehgssdcph3ma0prvrs/family1/187a0ab7ed174e80b5e784492e05b3c7 2023-11-18 00:55:49,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 00:55:49,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 00:55:49,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(1912): 02b1e7a1949f099eff40c89fdf701b6f/family1 is initiating minor compaction (all files) 2023-11-18 00:55:49,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4d463428; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:49,109 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 02b1e7a1949f099eff40c89fdf701b6f/family1 in testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:55:49,109 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/8a27c340b00e4900a23da5fbabb0c802, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/319a77d32a33442fb8b5ab5174620763, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp, totalSize=344.3 K 2023-11-18 00:55:49,110 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 8a27c340b00e4900a23da5fbabb0c802, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823326 2023-11-18 00:55:49,110 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 319a77d32a33442fb8b5ab5174620763, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223326 2023-11-18 00:55:49,110 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting 6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965223326 2023-11-18 00:55:49,111 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] compactions.Compactor(207): Compacting ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014823326 2023-11-18 00:55:49,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:55:49,111 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:49,113 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120398e4177aba74876aaf852ff6c5d2515 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120398e4177aba74876aaf852ff6c5d2515 2023-11-18 00:55:49,114 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128ed18b23b6e27474fa2ba72acad7a849a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128ed18b23b6e27474fa2ba72acad7a849a 2023-11-18 00:55:49,115 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a2bff3e457bf46eaba8513f17e04fc5b to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a2bff3e457bf46eaba8513f17e04fc5b 2023-11-18 00:55:49,115 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-18 00:55:49,115 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 00:55:49,116 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:55:49,116 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:55:49,116 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 00:55:49,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 00:55:49,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:55:49,118 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 00:55:49,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4590 sec 2023-11-18 00:55:49,129 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] throttle.PressureAwareThroughputController(145): 02b1e7a1949f099eff40c89fdf701b6f#family1#compaction#167 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:55:49,315 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=262 (was 251) - Thread LEAK? -, OpenFileDescriptor=682 (was 647) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=137 (was 143), ProcessCount=172 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=9672 (was 9677) 2023-11-18 00:55:49,326 INFO [Listener at localhost/41175] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=262, OpenFileDescriptor=682, MaxFileDescriptor=60000, SystemLoadAverage=137, ProcessCount=172, AvailableMemoryMB=9671 2023-11-18 00:55:49,346 DEBUG [Listener at localhost/41175] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-18 00:55:49,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xDE,X\xD7\xAB!?\xD5b\x05>\x01\xD6\xFC\xFC"\x10Ml\xF9\xC3\x1E\xB5\xCD\x8FU>\xA9\xBFH?\x12\x97*\x10\xC7\xC8\x138d\x09\x1F\xF1TS\x5C\x9E9\x81\xF2I2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 00:55:49,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-18 00:55:49,402 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 00:55:49,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-18 00:55:49,402 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 00:55:49,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 00:55:49,404 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:49,404 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:49,404 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:49,405 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b empty. 2023-11-18 00:55:49,405 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0 empty. 2023-11-18 00:55:49,405 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351 empty. 2023-11-18 00:55:49,405 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:49,405 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:49,405 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:49,405 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-18 00:55:49,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 00:55:49,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 00:55:49,812 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-18 00:55:49,814 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => ef6b76369f80dbd561cdb4901f4e5351, NAME => 'testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xDE,X\xD7\xAB!?\xD5b\x05>\x01\xD6\xFC\xFC"\x10Ml\xF9\xC3\x1E\xB5\xCD\x8FU>\xA9\xBFH?\x12\x97*\x10\xC7\xC8\x138d\x09\x1F\xF1TS\x5C\x9E9\x81\xF2I2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:55:49,814 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 445eac7d15f6befb858b73cb1ca55c8b, NAME => 'testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xDE,X\xD7\xAB!?\xD5b\x05>\x01\xD6\xFC\xFC"\x10Ml\xF9\xC3\x1E\xB5\xCD\x8FU>\xA9\xBFH?\x12\x97*\x10\xC7\xC8\x138d\x09\x1F\xF1TS\x5C\x9E9\x81\xF2I2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:55:49,814 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2105a8fa00c9746db00d3c0a044ab1d0, NAME => 'testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xDE,X\xD7\xAB!?\xD5b\x05>\x01\xD6\xFC\xFC"\x10Ml\xF9\xC3\x1E\xB5\xCD\x8FU>\xA9\xBFH?\x12\x97*\x10\xC7\xC8\x138d\x09\x1F\xF1TS\x5C\x9E9\x81\xF2I2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/.tmp 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 2105a8fa00c9746db00d3c0a044ab1d0, disabling compactions & flushes 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing ef6b76369f80dbd561cdb4901f4e5351, disabling compactions & flushes 2023-11-18 00:55:49,825 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:49,825 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. after waiting 0 ms 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. after waiting 0 ms 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:49,825 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:49,825 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:55:49,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:55:49,950 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/.tmp/family1/6d7b2f063ef94388b84e340a06f3d0f6 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6d7b2f063ef94388b84e340a06f3d0f6 2023-11-18 00:55:49,955 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 02b1e7a1949f099eff40c89fdf701b6f/family1 of 02b1e7a1949f099eff40c89fdf701b6f into 6d7b2f063ef94388b84e340a06f3d0f6(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:55:49,955 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:55:49,955 INFO [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1700268949109; duration=0sec 2023-11-18 00:55:49,955 DEBUG [RS:0;jenkins-hbase4:46287-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 00:55:49,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/8a27c340b00e4900a23da5fbabb0c802, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/319a77d32a33442fb8b5ab5174620763, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_] to archive 2023-11-18 00:55:49,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:55:49,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/8a27c340b00e4900a23da5fbabb0c802 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/8a27c340b00e4900a23da5fbabb0c802 2023-11-18 00:55:49,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/319a77d32a33442fb8b5ab5174620763 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/319a77d32a33442fb8b5ab5174620763 2023-11-18 00:55:49,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/6151379683bd40b0a6a546e0e4fb07bb_SeqId_46_ 2023-11-18 00:55:49,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_ to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/family1/ed4a6eddc76d41a4b685fdffa950b2c4_SeqId_49_ 2023-11-18 00:55:50,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 00:55:50,225 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:50,225 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 445eac7d15f6befb858b73cb1ca55c8b, disabling compactions & flushes 2023-11-18 00:55:50,225 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:50,225 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:50,225 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. after waiting 0 ms 2023-11-18 00:55:50,225 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:50,225 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:50,225 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:55:50,228 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 00:55:50,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700268950229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268950229"}]},"ts":"1700268950229"} 2023-11-18 00:55:50,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268950229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268950229"}]},"ts":"1700268950229"} 2023-11-18 00:55:50,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268950229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700268950229"}]},"ts":"1700268950229"} 2023-11-18 00:55:50,231 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 00:55:50,231 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 00:55:50,231 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268950231"}]},"ts":"1700268950231"} 2023-11-18 00:55:50,232 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-18 00:55:50,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=445eac7d15f6befb858b73cb1ca55c8b, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2105a8fa00c9746db00d3c0a044ab1d0, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ef6b76369f80dbd561cdb4901f4e5351, ASSIGN}] 2023-11-18 00:55:50,239 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ef6b76369f80dbd561cdb4901f4e5351, ASSIGN 2023-11-18 00:55:50,239 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=445eac7d15f6befb858b73cb1ca55c8b, ASSIGN 2023-11-18 00:55:50,239 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2105a8fa00c9746db00d3c0a044ab1d0, ASSIGN 2023-11-18 00:55:50,239 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ef6b76369f80dbd561cdb4901f4e5351, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:55:50,239 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=445eac7d15f6befb858b73cb1ca55c8b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:55:50,239 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2105a8fa00c9746db00d3c0a044ab1d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1700268799711; forceNewPlan=false, retain=false 2023-11-18 00:55:50,391 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=445eac7d15f6befb858b73cb1ca55c8b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:50,391 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=2105a8fa00c9746db00d3c0a044ab1d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:50,391 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268950391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268950391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268950391"}]},"ts":"1700268950391"} 2023-11-18 00:55:50,391 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ef6b76369f80dbd561cdb4901f4e5351, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:50,391 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700268950391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268950391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268950391"}]},"ts":"1700268950391"} 2023-11-18 00:55:50,391 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268950391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700268950391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700268950391"}]},"ts":"1700268950391"} 2023-11-18 00:55:50,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 445eac7d15f6befb858b73cb1ca55c8b, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:50,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 2105a8fa00c9746db00d3c0a044ab1d0, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:50,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure ef6b76369f80dbd561cdb4901f4e5351, server=jenkins-hbase4.apache.org,46287,1700268799711}] 2023-11-18 00:55:50,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 00:55:50,544 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:50,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:50,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2105a8fa00c9746db00d3c0a044ab1d0, NAME => 'testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 00:55:50,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:50,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:50,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:50,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:50,568 INFO [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:50,570 DEBUG [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1 2023-11-18 00:55:50,570 DEBUG [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1 2023-11-18 00:55:50,570 INFO [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2105a8fa00c9746db00d3c0a044ab1d0 columnFamilyName family1 2023-11-18 00:55:50,571 INFO [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] regionserver.HStore(310): Store=2105a8fa00c9746db00d3c0a044ab1d0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:50,572 INFO [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:50,573 DEBUG [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2 2023-11-18 00:55:50,573 DEBUG [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2 2023-11-18 00:55:50,573 INFO [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2105a8fa00c9746db00d3c0a044ab1d0 columnFamilyName family2 2023-11-18 00:55:50,574 INFO [StoreOpener-2105a8fa00c9746db00d3c0a044ab1d0-1] regionserver.HStore(310): Store=2105a8fa00c9746db00d3c0a044ab1d0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:50,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:50,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:50,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:50,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:55:50,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:55:50,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2105a8fa00c9746db00d3c0a044ab1d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64040636, jitterRate=-0.04572016000747681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:50,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:55:50,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0., pid=121, masterSystemTime=1700268950544 2023-11-18 00:55:50,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:50,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:50,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:50,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 445eac7d15f6befb858b73cb1ca55c8b, NAME => 'testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 00:55:50,581 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=2105a8fa00c9746db00d3c0a044ab1d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:50,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:50,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:50,581 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700268950581"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268950581"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268950581"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268950581"}]},"ts":"1700268950581"} 2023-11-18 00:55:50,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:50,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:50,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=118 2023-11-18 00:55:50,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 2105a8fa00c9746db00d3c0a044ab1d0, server=jenkins-hbase4.apache.org,46287,1700268799711 in 189 msec 2023-11-18 00:55:50,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2105a8fa00c9746db00d3c0a044ab1d0, ASSIGN in 346 msec 2023-11-18 00:55:50,601 INFO [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:50,602 DEBUG [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1 2023-11-18 00:55:50,602 DEBUG [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1 2023-11-18 00:55:50,603 INFO [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 445eac7d15f6befb858b73cb1ca55c8b columnFamilyName family1 2023-11-18 00:55:50,603 INFO [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] regionserver.HStore(310): Store=445eac7d15f6befb858b73cb1ca55c8b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:50,604 INFO [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:50,604 DEBUG [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2 2023-11-18 00:55:50,605 DEBUG [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2 2023-11-18 00:55:50,605 INFO [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 445eac7d15f6befb858b73cb1ca55c8b columnFamilyName family2 2023-11-18 00:55:50,605 INFO [StoreOpener-445eac7d15f6befb858b73cb1ca55c8b-1] regionserver.HStore(310): Store=445eac7d15f6befb858b73cb1ca55c8b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:50,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:50,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:50,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:50,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:55:50,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:55:50,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 445eac7d15f6befb858b73cb1ca55c8b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62691806, jitterRate=-0.06581929326057434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:50,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:55:50,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b., pid=120, masterSystemTime=1700268950544 2023-11-18 00:55:50,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:50,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:50,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:50,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef6b76369f80dbd561cdb4901f4e5351, NAME => 'testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 00:55:50,612 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=445eac7d15f6befb858b73cb1ca55c8b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:50,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:50,612 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268950612"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268950612"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268950612"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268950612"}]},"ts":"1700268950612"} 2023-11-18 00:55:50,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 00:55:50,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:50,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:50,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-11-18 00:55:50,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 445eac7d15f6befb858b73cb1ca55c8b, server=jenkins-hbase4.apache.org,46287,1700268799711 in 222 msec 2023-11-18 00:55:50,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=445eac7d15f6befb858b73cb1ca55c8b, ASSIGN in 378 msec 2023-11-18 00:55:50,634 INFO [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:50,635 DEBUG [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1 2023-11-18 00:55:50,635 DEBUG [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1 2023-11-18 00:55:50,635 INFO [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef6b76369f80dbd561cdb4901f4e5351 columnFamilyName family1 2023-11-18 00:55:50,636 INFO [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] regionserver.HStore(310): Store=ef6b76369f80dbd561cdb4901f4e5351/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:50,636 INFO [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:50,637 DEBUG [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2 2023-11-18 00:55:50,637 DEBUG [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2 2023-11-18 00:55:50,637 INFO [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef6b76369f80dbd561cdb4901f4e5351 columnFamilyName family2 2023-11-18 00:55:50,638 INFO [StoreOpener-ef6b76369f80dbd561cdb4901f4e5351-1] regionserver.HStore(310): Store=ef6b76369f80dbd561cdb4901f4e5351/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 00:55:50,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:50,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:50,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 00:55:50,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:55:50,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 00:55:50,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef6b76369f80dbd561cdb4901f4e5351; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61578838, jitterRate=-0.08240380883216858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 00:55:50,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:55:50,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351., pid=122, masterSystemTime=1700268950544 2023-11-18 00:55:50,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:50,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:50,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ef6b76369f80dbd561cdb4901f4e5351, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:50,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700268950645"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700268950645"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700268950645"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700268950645"}]},"ts":"1700268950645"} 2023-11-18 00:55:50,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=119 2023-11-18 00:55:50,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure ef6b76369f80dbd561cdb4901f4e5351, server=jenkins-hbase4.apache.org,46287,1700268799711 in 252 msec 2023-11-18 00:55:50,649 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=119, resume processing ppid=116 2023-11-18 00:55:50,649 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ef6b76369f80dbd561cdb4901f4e5351, ASSIGN in 410 msec 2023-11-18 00:55:50,649 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 00:55:50,649 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700268950649"}]},"ts":"1700268950649"} 2023-11-18 00:55:50,650 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-18 00:55:50,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 00:55:50,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2520 sec 2023-11-18 00:55:51,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 00:55:51,508 INFO [Listener at localhost/41175] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-18 00:55:51,513 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:51,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:51,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:51,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:51,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 00:55:51,518 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 00:55:51,518 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:51,518 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 00:55:51,518 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 00:55:51,518 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:51,518 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:51,520 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:51,520 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:51,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:51,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:51,520 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:51,520 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:51,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:51,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:51,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:51,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:51,521 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 00:55:51,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 00:55:51,521 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 00:55:51,521 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:51,521 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 00:55:51,521 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:51,521 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. started... 2023-11-18 00:55:51,522 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:51,522 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:51,522 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef6b76369f80dbd561cdb4901f4e5351 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:55:51,522 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. started... 2023-11-18 00:55:51,522 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. started... 2023-11-18 00:55:51,522 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:51,523 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2105a8fa00c9746db00d3c0a044ab1d0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:55:51,523 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:51,523 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 445eac7d15f6befb858b73cb1ca55c8b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 00:55:51,574 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311180a72210e4a764709a4a8f77fc842eca2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311180a72210e4a764709a4a8f77fc842eca2 2023-11-18 00:55:51,599 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-18 00:55:51,971 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111859cb9ac50a6e4f668f6c9576888e4600 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111859cb9ac50a6e4f668f6c9576888e4600 2023-11-18 00:55:51,979 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118150f08c9390847239f9ff4276062fa14 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118150f08c9390847239f9ff4276062fa14 2023-11-18 00:55:51,989 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/f3b36ab81c5d42ee9bfa14c0446191ad 2023-11-18 00:55:52,390 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/8643b058a8c2463da9ba86e017ad3719 2023-11-18 00:55:52,398 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/716667f021c84d73a160c2b096601759 2023-11-18 00:55:52,424 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311186f11ae3388b446c5bb2747ea254abef2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311186f11ae3388b446c5bb2747ea254abef2 2023-11-18 00:55:52,426 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118bd65a2b425d74fdf86948ba63ec1cc23 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231118bd65a2b425d74fdf86948ba63ec1cc23 2023-11-18 00:55:52,430 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/0eb2e3f8da9f414bb85dff27b3aee872 2023-11-18 00:55:52,432 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/d3bdc39417f54a98b1d96138dca12715 2023-11-18 00:55:52,434 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/f3b36ab81c5d42ee9bfa14c0446191ad as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/f3b36ab81c5d42ee9bfa14c0446191ad 2023-11-18 00:55:52,434 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311184850325e32dd403aaed4c7bb8247d9b7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311184850325e32dd403aaed4c7bb8247d9b7 2023-11-18 00:55:52,437 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/8643b058a8c2463da9ba86e017ad3719 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8643b058a8c2463da9ba86e017ad3719 2023-11-18 00:55:52,441 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/460f9e615aa045579ca57085d4e51c95 2023-11-18 00:55:52,449 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/716667f021c84d73a160c2b096601759 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/716667f021c84d73a160c2b096601759 2023-11-18 00:55:52,466 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8643b058a8c2463da9ba86e017ad3719, entries=4, sequenceid=5, filesize=5.5 K 2023-11-18 00:55:52,467 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/d3bdc39417f54a98b1d96138dca12715 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/d3bdc39417f54a98b1d96138dca12715 2023-11-18 00:55:52,469 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/f3b36ab81c5d42ee9bfa14c0446191ad, entries=4, sequenceid=5, filesize=5.5 K 2023-11-18 00:55:52,470 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/0eb2e3f8da9f414bb85dff27b3aee872 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/0eb2e3f8da9f414bb85dff27b3aee872 2023-11-18 00:55:52,471 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/d3bdc39417f54a98b1d96138dca12715, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:55:52,472 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 445eac7d15f6befb858b73cb1ca55c8b in 948ms, sequenceid=5, compaction requested=false 2023-11-18 00:55:52,472 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:55:52,472 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:52,473 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:52,473 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/716667f021c84d73a160c2b096601759, entries=4, sequenceid=5, filesize=5.5 K 2023-11-18 00:55:52,474 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/460f9e615aa045579ca57085d4e51c95 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/460f9e615aa045579ca57085d4e51c95 2023-11-18 00:55:52,475 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/0eb2e3f8da9f414bb85dff27b3aee872, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:55:52,475 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ef6b76369f80dbd561cdb4901f4e5351 in 953ms, sequenceid=5, compaction requested=false 2023-11-18 00:55:52,476 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:55:52,476 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:52,476 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:52,477 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/460f9e615aa045579ca57085d4e51c95, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 00:55:52,477 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2105a8fa00c9746db00d3c0a044ab1d0 in 954ms, sequenceid=5, compaction requested=false 2023-11-18 00:55:52,478 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:55:52,478 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:52,478 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:52,478 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:52,478 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,478 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 00:55:52,478 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 00:55:52,483 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,483 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:52,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:52,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:52,484 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:52,484 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:52,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:52,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:52,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:52,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:52,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 00:55:52,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16aff3c6[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:52,485 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 00:55:52,485 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:52,486 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:52,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:52,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:52,487 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 00:55:52,487 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 00:55:52,487 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:52,487 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,487 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:52,488 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,488 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 00:55:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:52,488 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:52,488 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 00:55:52,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:52,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:52,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:52,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:52,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:52,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:52,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 00:55:52,491 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 00:55:52,491 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:52,491 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:52,491 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 00:55:52,491 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:52,496 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,496 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,496 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:52,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:52,497 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:52,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:52,498 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,500 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,500 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:52,500 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:52,500 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:52,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:52,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:52,500 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,500 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:52,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 00:55:52,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:52,501 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:52,501 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:52,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-18 00:55:52,501 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:52,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:52,501 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:52,501 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,501 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:52,601 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:52,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:52,603 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:52,604 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:52,604 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:52,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:52,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:52,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 00:55:52,609 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 00:55:52,609 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:52,609 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 00:55:52,609 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 00:55:52,609 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,609 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:52,611 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,611 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:52,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:52,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:52,611 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:52,611 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:52,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:52,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:52,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:52,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:52,612 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 00:55:52,612 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-18 00:55:52,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 00:55:52,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 00:55:52,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:52,612 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 00:55:52,613 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:52,613 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. started... 2023-11-18 00:55:52,613 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:52,613 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:52,613 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:52,613 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:52,613 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. started... 2023-11-18 00:55:52,613 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef6b76369f80dbd561cdb4901f4e5351 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:55:52,613 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2105a8fa00c9746db00d3c0a044ab1d0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:55:52,613 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. started... 2023-11-18 00:55:52,613 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 445eac7d15f6befb858b73cb1ca55c8b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 00:55:52,666 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118ee8677ddb1d74973817312fab206dfe0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ee8677ddb1d74973817312fab206dfe0 2023-11-18 00:55:53,061 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311188871f0891c7b4bd995eb803bb4d2c39f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311188871f0891c7b4bd995eb803bb4d2c39f 2023-11-18 00:55:53,065 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311187afe2fda7b9143b68a2932003a5791c5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311187afe2fda7b9143b68a2932003a5791c5 2023-11-18 00:55:53,087 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/35946be8d6cb4eebbe4330db808d85cd 2023-11-18 00:55:53,137 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311181ad2482e42d14e9ea0cc5bf2ab665996 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311181ad2482e42d14e9ea0cc5bf2ab665996 2023-11-18 00:55:53,476 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/8f61453b573745c5ad4b5b5663bed159 2023-11-18 00:55:53,485 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/53b26593814d44ec93bd1f3b297d36ed 2023-11-18 00:55:53,542 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/355a35cbb7de4c0d86198ea807436e53 2023-11-18 00:55:53,545 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/35946be8d6cb4eebbe4330db808d85cd as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/35946be8d6cb4eebbe4330db808d85cd 2023-11-18 00:55:53,568 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/35946be8d6cb4eebbe4330db808d85cd, entries=4, sequenceid=9, filesize=5.5 K 2023-11-18 00:55:53,569 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/355a35cbb7de4c0d86198ea807436e53 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/355a35cbb7de4c0d86198ea807436e53 2023-11-18 00:55:53,572 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/355a35cbb7de4c0d86198ea807436e53, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:55:53,573 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 445eac7d15f6befb858b73cb1ca55c8b in 960ms, sequenceid=9, compaction requested=false 2023-11-18 00:55:53,573 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:55:53,573 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:53,573 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:53,909 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311182ce65849f87a4948bc6f0e74aa08e8e7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311182ce65849f87a4948bc6f0e74aa08e8e7 2023-11-18 00:55:53,916 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118f42d8de972b34da8aaf3123215489e21 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231118f42d8de972b34da8aaf3123215489e21 2023-11-18 00:55:54,315 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/c7852d57875841229d0d37565020a8bf 2023-11-18 00:55:54,318 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/8f61453b573745c5ad4b5b5663bed159 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8f61453b573745c5ad4b5b5663bed159 2023-11-18 00:55:54,321 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/e7ae665b946c42c3a78d642b71483bb3 2023-11-18 00:55:54,324 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/53b26593814d44ec93bd1f3b297d36ed as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/53b26593814d44ec93bd1f3b297d36ed 2023-11-18 00:55:54,342 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8f61453b573745c5ad4b5b5663bed159, entries=4, sequenceid=9, filesize=5.5 K 2023-11-18 00:55:54,343 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/c7852d57875841229d0d37565020a8bf as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/c7852d57875841229d0d37565020a8bf 2023-11-18 00:55:54,345 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/c7852d57875841229d0d37565020a8bf, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:55:54,346 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ef6b76369f80dbd561cdb4901f4e5351 in 1733ms, sequenceid=9, compaction requested=false 2023-11-18 00:55:54,346 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:55:54,346 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:54,346 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:54,355 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/53b26593814d44ec93bd1f3b297d36ed, entries=4, sequenceid=9, filesize=5.5 K 2023-11-18 00:55:54,355 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/e7ae665b946c42c3a78d642b71483bb3 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/e7ae665b946c42c3a78d642b71483bb3 2023-11-18 00:55:54,358 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/e7ae665b946c42c3a78d642b71483bb3, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 00:55:54,359 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2105a8fa00c9746db00d3c0a044ab1d0 in 1746ms, sequenceid=9, compaction requested=false 2023-11-18 00:55:54,359 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:55:54,359 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:54,359 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:54,359 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:54,359 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,359 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 00:55:54,359 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 00:55:54,361 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,361 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:54,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:54,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:54,362 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:54,362 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:54,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:54,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:54,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:54,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:54,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 00:55:54,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@264a326[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:54,363 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 00:55:54,363 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:54,365 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:54,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:54,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:54,365 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 00:55:54,365 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 00:55:54,365 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:54,365 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,366 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 00:55:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:54,367 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,367 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 00:55:54,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:54,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:54,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:54,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:54,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:54,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:54,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 00:55:54,369 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 00:55:54,369 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:54,369 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:54,369 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 00:55:54,369 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:54,370 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,370 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,370 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,371 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:54,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:54,372 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:54,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:54,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 00:55:54,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:54,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:54,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-18 00:55:54,375 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:54,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:54,375 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:54,376 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:54,376 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,476 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:54,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:54,477 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:54,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:54,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:54,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:54,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:54,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 00:55:54,482 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 00:55:54,482 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:54,482 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 00:55:54,482 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 00:55:54,482 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,482 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:54,485 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:54,485 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:54,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:54,486 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:54,486 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:54,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:54,486 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 00:55:54,487 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-18 00:55:54,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 00:55:54,487 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 00:55:54,487 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:54,487 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 00:55:54,487 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:54,487 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:54,487 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:54,487 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:54,487 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. started... 2023-11-18 00:55:54,487 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:54,487 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. started... 2023-11-18 00:55:54,487 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. started... 2023-11-18 00:55:54,487 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef6b76369f80dbd561cdb4901f4e5351 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:55:54,487 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 445eac7d15f6befb858b73cb1ca55c8b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:55:54,487 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2105a8fa00c9746db00d3c0a044ab1d0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 00:55:54,544 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311180581186e5f084393abb9932fe1cdefcf to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311180581186e5f084393abb9932fe1cdefcf 2023-11-18 00:55:54,553 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311183217b4f55de04c5581bad1bb168aa296 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311183217b4f55de04c5581bad1bb168aa296 2023-11-18 00:55:54,561 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/f20cbab59f0140a7ad5160ca710a43b5 2023-11-18 00:55:54,571 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/8d860904a15748f79776e230946a817a 2023-11-18 00:55:54,946 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118a40f4fd772a84b0285b2f11aafcaf5b2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118a40f4fd772a84b0285b2f11aafcaf5b2 2023-11-18 00:55:55,002 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111816032e94328f495bbac763d46afca676 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111816032e94328f495bbac763d46afca676 2023-11-18 00:55:55,002 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311185bb76b7e6b984893b170c709dbea0ea4 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311185bb76b7e6b984893b170c709dbea0ea4 2023-11-18 00:55:55,014 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/39ec4f7b40614e7ebe218d4e69bc2afe 2023-11-18 00:55:55,019 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/f20cbab59f0140a7ad5160ca710a43b5 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/f20cbab59f0140a7ad5160ca710a43b5 2023-11-18 00:55:55,052 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/f20cbab59f0140a7ad5160ca710a43b5, entries=4, sequenceid=13, filesize=5.5 K 2023-11-18 00:55:55,053 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/39ec4f7b40614e7ebe218d4e69bc2afe as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/39ec4f7b40614e7ebe218d4e69bc2afe 2023-11-18 00:55:55,056 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/39ec4f7b40614e7ebe218d4e69bc2afe, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:55:55,057 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2105a8fa00c9746db00d3c0a044ab1d0 in 570ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:55,057 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:55:55,057 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:55,057 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:55,361 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/66b641f1ba094b4b960fc2e5c2afb3a7 2023-11-18 00:55:55,415 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/6566e05acdd64e0e9f7b85ebbee03fae 2023-11-18 00:55:55,418 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/8d860904a15748f79776e230946a817a as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8d860904a15748f79776e230946a817a 2023-11-18 00:55:55,441 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8d860904a15748f79776e230946a817a, entries=4, sequenceid=13, filesize=5.5 K 2023-11-18 00:55:55,442 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/6566e05acdd64e0e9f7b85ebbee03fae as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/6566e05acdd64e0e9f7b85ebbee03fae 2023-11-18 00:55:55,445 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/6566e05acdd64e0e9f7b85ebbee03fae, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:55:55,446 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ef6b76369f80dbd561cdb4901f4e5351 in 959ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:55,446 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:55:55,446 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:55,446 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:55,594 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:55:55,594 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ef36be8 to 127.0.0.1:58527 2023-11-18 00:55:55,594 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:55:55,595 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:55:55,595 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b6ebe81 to 127.0.0.1:58527 2023-11-18 00:55:55,595 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:55:55,793 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118b4d0ab5c6c3b4f20b5ee5216e7d65e97 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231118b4d0ab5c6c3b4f20b5ee5216e7d65e97 2023-11-18 00:55:56,103 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 00:55:56,200 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/ec9c3322dcbf4d188b0fe060cbe386ef 2023-11-18 00:55:56,204 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/66b641f1ba094b4b960fc2e5c2afb3a7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/66b641f1ba094b4b960fc2e5c2afb3a7 2023-11-18 00:55:56,229 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/66b641f1ba094b4b960fc2e5c2afb3a7, entries=4, sequenceid=13, filesize=5.5 K 2023-11-18 00:55:56,229 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/ec9c3322dcbf4d188b0fe060cbe386ef as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/ec9c3322dcbf4d188b0fe060cbe386ef 2023-11-18 00:55:56,233 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/ec9c3322dcbf4d188b0fe060cbe386ef, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 00:55:56,234 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 445eac7d15f6befb858b73cb1ca55c8b in 1747ms, sequenceid=13, compaction requested=true 2023-11-18 00:55:56,234 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:55:56,234 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 00:55:56,234 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 00:55:56,236 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,236 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:56,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:56,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:56,236 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:56,236 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:56,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:56,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:56,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:56,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:56,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 00:55:56,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e0ba467[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:56,238 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 00:55:56,238 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:56,240 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:56,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:56,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:56,241 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 00:55:56,241 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 00:55:56,241 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:56,241 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,241 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:56,242 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,242 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 00:55:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,242 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:56,242 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 00:55:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:56,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 00:55:56,245 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 00:55:56,245 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:56,245 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:56,245 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 00:55:56,245 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:56,247 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,247 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,247 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:56,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:56,247 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:56,249 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,251 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,251 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:56,251 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:56,251 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:56,251 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 00:55:56,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:56,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-18 00:55:56,251 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:56,251 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:56,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:56,251 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:56,252 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:56,252 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:56,252 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,252 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:56,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:56,352 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:56,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:56,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:56,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:56,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 00:55:56,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:56,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:56,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 00:55:56,358 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 00:55:56,359 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:56,359 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 00:55:56,359 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 00:55:56,359 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,359 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:56,361 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,361 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:56,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:56,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:56,361 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:56,361 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:56,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:56,362 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 00:55:56,362 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-18 00:55:56,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 00:55:56,362 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 00:55:56,362 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:56,363 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 00:55:56,363 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:56,363 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. started... 2023-11-18 00:55:56,363 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:56,363 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:56,363 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef6b76369f80dbd561cdb4901f4e5351 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:56,363 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. started... 2023-11-18 00:55:56,363 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:56,363 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:56,363 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 445eac7d15f6befb858b73cb1ca55c8b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:56,363 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. started... 2023-11-18 00:55:56,363 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2105a8fa00c9746db00d3c0a044ab1d0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 00:55:56,403 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311184ace1112673747f38e3fe0fe20727cb1 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311184ace1112673747f38e3fe0fe20727cb1 2023-11-18 00:55:56,403 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311185b587c111f4448b7b0e524306c5c62a7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311185b587c111f4448b7b0e524306c5c62a7 2023-11-18 00:55:56,418 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/2ad90eee1bc34bb89cbdb5c97e14f34d 2023-11-18 00:55:56,804 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111895999371f29c4dff97526d13292e6a38 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111895999371f29c4dff97526d13292e6a38 2023-11-18 00:55:56,818 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/5255811ee6d74f4a93d862f07dd463fe 2023-11-18 00:55:56,851 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311181521e31e6570413384a5a0b137dd09de to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311181521e31e6570413384a5a0b137dd09de 2023-11-18 00:55:56,855 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/506b2dd6ed094f68864789d8bc111067 2023-11-18 00:55:56,859 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/2ad90eee1bc34bb89cbdb5c97e14f34d as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/2ad90eee1bc34bb89cbdb5c97e14f34d 2023-11-18 00:55:56,891 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/2ad90eee1bc34bb89cbdb5c97e14f34d, entries=4, sequenceid=17, filesize=5.5 K 2023-11-18 00:55:56,892 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/506b2dd6ed094f68864789d8bc111067 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/506b2dd6ed094f68864789d8bc111067 2023-11-18 00:55:56,895 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/506b2dd6ed094f68864789d8bc111067, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:56,896 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2105a8fa00c9746db00d3c0a044ab1d0 in 533ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:56,896 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:55:56,896 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:56,896 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:57,218 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/d3e8bb78d745444ea21e28d0b23676fc 2023-11-18 00:55:57,248 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118bcb20384bb0c4284a637d756667ae504 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231118bcb20384bb0c4284a637d756667ae504 2023-11-18 00:55:57,254 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/53b0d54c852c410e9ee0c45a2343977f 2023-11-18 00:55:57,257 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/5255811ee6d74f4a93d862f07dd463fe as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/5255811ee6d74f4a93d862f07dd463fe 2023-11-18 00:55:57,281 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/5255811ee6d74f4a93d862f07dd463fe, entries=4, sequenceid=17, filesize=5.5 K 2023-11-18 00:55:57,282 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/53b0d54c852c410e9ee0c45a2343977f as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/53b0d54c852c410e9ee0c45a2343977f 2023-11-18 00:55:57,285 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/53b0d54c852c410e9ee0c45a2343977f, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:57,286 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 445eac7d15f6befb858b73cb1ca55c8b in 923ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:57,286 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:55:57,286 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:57,286 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:57,655 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118ce1d6eb5f0f64c47be918b5eff1c7aad to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231118ce1d6eb5f0f64c47be918b5eff1c7aad 2023-11-18 00:55:58,060 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/a35f70f775c14129b413e044cc62b551 2023-11-18 00:55:58,064 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/d3e8bb78d745444ea21e28d0b23676fc as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d3e8bb78d745444ea21e28d0b23676fc 2023-11-18 00:55:58,090 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d3e8bb78d745444ea21e28d0b23676fc, entries=4, sequenceid=17, filesize=5.5 K 2023-11-18 00:55:58,091 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/a35f70f775c14129b413e044cc62b551 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/a35f70f775c14129b413e044cc62b551 2023-11-18 00:55:58,094 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/a35f70f775c14129b413e044cc62b551, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 00:55:58,095 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ef6b76369f80dbd561cdb4901f4e5351 in 1732ms, sequenceid=17, compaction requested=true 2023-11-18 00:55:58,095 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:55:58,095 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 00:55:58,097 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,097 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:58,097 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:58,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 00:55:58,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bec490c[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:58,099 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 00:55:58,099 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:58,106 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:58,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:58,107 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 00:55:58,107 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,107 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:58,107 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 00:55:58,107 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:58,108 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 00:55:58,108 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,108 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:58,108 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 00:55:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:58,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 00:55:58,110 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 00:55:58,110 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:58,110 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:58,110 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 00:55:58,110 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:58,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:58,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,112 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:58,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:58,112 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:58,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,114 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:58,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:58,117 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:58,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:58,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 00:55:58,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:58,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:58,117 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,118 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:58,118 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:58,118 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,118 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:58,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:58,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:58,118 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:58,218 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:58,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:58,228 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:58,236 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:58,244 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:55:58,245 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:55:58,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 00:55:58,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-18 00:55:58,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 00:55:58,345 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 00:55:58,345 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:58,345 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 00:55:58,345 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 00:55:58,345 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,345 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:58,347 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,347 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:58,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:58,347 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:58,347 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 00:55:58,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:58,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 00:55:58,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:58,348 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 00:55:58,348 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-18 00:55:58,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 00:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 00:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 00:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 00:55:58,348 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:58,348 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:58,348 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:58,348 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. started... 2023-11-18 00:55:58,348 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. started... 2023-11-18 00:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 00:55:58,348 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2105a8fa00c9746db00d3c0a044ab1d0 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:58,349 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 445eac7d15f6befb858b73cb1ca55c8b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:58,348 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 00:55:58,348 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. started... 2023-11-18 00:55:58,349 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ef6b76369f80dbd561cdb4901f4e5351 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 00:55:58,394 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/601c8aca0a464ca6b26ad97d7d6145a3 2023-11-18 00:55:58,399 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/1391e07d5a4e4977b48d1b01fcb94f25 2023-11-18 00:55:58,416 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 601c8aca0a464ca6b26ad97d7d6145a3 2023-11-18 00:55:58,422 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1391e07d5a4e4977b48d1b01fcb94f25 2023-11-18 00:55:58,434 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/898bad99e0c6455cb02b3e8758b43ffc 2023-11-18 00:55:58,437 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 898bad99e0c6455cb02b3e8758b43ffc 2023-11-18 00:55:58,437 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/601c8aca0a464ca6b26ad97d7d6145a3 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/601c8aca0a464ca6b26ad97d7d6145a3 2023-11-18 00:55:58,460 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 601c8aca0a464ca6b26ad97d7d6145a3 2023-11-18 00:55:58,460 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/601c8aca0a464ca6b26ad97d7d6145a3, entries=3, sequenceid=23, filesize=5.2 K 2023-11-18 00:55:58,461 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/898bad99e0c6455cb02b3e8758b43ffc as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/898bad99e0c6455cb02b3e8758b43ffc 2023-11-18 00:55:58,464 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 898bad99e0c6455cb02b3e8758b43ffc 2023-11-18 00:55:58,464 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/898bad99e0c6455cb02b3e8758b43ffc, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:58,465 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 445eac7d15f6befb858b73cb1ca55c8b in 116ms, sequenceid=23, compaction requested=true 2023-11-18 00:55:58,465 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:55:58,465 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:55:58,465 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 00:55:58,787 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/96b6a0d5683444bea3cf50e6e9136dc0 2023-11-18 00:55:58,810 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96b6a0d5683444bea3cf50e6e9136dc0 2023-11-18 00:55:59,239 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/005709d5d9be4f8db68a34d608226765 2023-11-18 00:55:59,242 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 005709d5d9be4f8db68a34d608226765 2023-11-18 00:55:59,243 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/1391e07d5a4e4977b48d1b01fcb94f25 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/1391e07d5a4e4977b48d1b01fcb94f25 2023-11-18 00:55:59,266 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1391e07d5a4e4977b48d1b01fcb94f25 2023-11-18 00:55:59,266 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/1391e07d5a4e4977b48d1b01fcb94f25, entries=3, sequenceid=23, filesize=5.2 K 2023-11-18 00:55:59,266 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/005709d5d9be4f8db68a34d608226765 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/005709d5d9be4f8db68a34d608226765 2023-11-18 00:55:59,269 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 005709d5d9be4f8db68a34d608226765 2023-11-18 00:55:59,270 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/005709d5d9be4f8db68a34d608226765, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:59,270 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2105a8fa00c9746db00d3c0a044ab1d0 in 922ms, sequenceid=23, compaction requested=true 2023-11-18 00:55:59,270 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:55:59,270 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:55:59,270 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 00:55:59,621 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/d1c5e514a719462fb214e97b203d1b89 2023-11-18 00:55:59,624 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1c5e514a719462fb214e97b203d1b89 2023-11-18 00:55:59,625 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/96b6a0d5683444bea3cf50e6e9136dc0 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/96b6a0d5683444bea3cf50e6e9136dc0 2023-11-18 00:55:59,648 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96b6a0d5683444bea3cf50e6e9136dc0 2023-11-18 00:55:59,648 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/96b6a0d5683444bea3cf50e6e9136dc0, entries=3, sequenceid=23, filesize=5.2 K 2023-11-18 00:55:59,648 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/d1c5e514a719462fb214e97b203d1b89 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/d1c5e514a719462fb214e97b203d1b89 2023-11-18 00:55:59,652 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1c5e514a719462fb214e97b203d1b89 2023-11-18 00:55:59,652 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/d1c5e514a719462fb214e97b203d1b89, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 00:55:59,653 INFO [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ef6b76369f80dbd561cdb4901f4e5351 in 1304ms, sequenceid=23, compaction requested=true 2023-11-18 00:55:59,653 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:55:59,653 DEBUG [rs(jenkins-hbase4.apache.org,46287,1700268799711)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:59,653 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 00:55:59,653 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 00:55:59,653 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,653 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 00:55:59,653 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 00:55:59,655 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,655 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:59,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:59,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:59,656 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:59,656 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 00:55:59,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:59,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:59,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:59,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:59,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1700268799711' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 00:55:59,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7234a874[Count = 0] remaining members to acquire global barrier 2023-11-18 00:55:59,657 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 00:55:59,657 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:59,659 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:59,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:59,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:59,659 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 00:55:59,659 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 00:55:59,659 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,46287,1700268799711' in zk 2023-11-18 00:55:59,659 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,659 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 00:55:59,661 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 00:55:59,661 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:59,662 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,662 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1700268799711' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 00:55:59,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:59,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:59,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:59,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:59,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:59,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:59,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:59,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,46287,1700268799711': 2023-11-18 00:55:59,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1700268799711' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 00:55:59,664 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 00:55:59,664 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 00:55:59,664 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 00:55:59,664 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 00:55:59,664 INFO [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 00:55:59,666 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:59,666 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:59,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:59,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:59,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 00:55:59,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 00:55:59,666 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:59,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:59,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 00:55:59,667 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:59,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:59,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:59,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:59,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 00:55:59,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:59,668 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 00:55:59,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 00:55:59,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,671 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,671 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 00:55:59,672 DEBUG [(jenkins-hbase4.apache.org,38477,1700268798477)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 00:55:59,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 00:55:59,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 00:55:59,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 00:55:59,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 00:55:59,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 00:55:59,672 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 00:55:59,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 00:55:59,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 00:55:59,772 DEBUG [Listener at localhost/41175] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 00:55:59,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 00:55:59,774 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:55:59,774 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): ef6b76369f80dbd561cdb4901f4e5351/family1 is initiating major compaction (all files) 2023-11-18 00:55:59,774 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:55:59,774 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:55:59,774 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of ef6b76369f80dbd561cdb4901f4e5351/family1 in testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:55:59,774 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/f3b36ab81c5d42ee9bfa14c0446191ad, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8f61453b573745c5ad4b5b5663bed159, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8d860904a15748f79776e230946a817a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d3e8bb78d745444ea21e28d0b23676fc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/96b6a0d5683444bea3cf50e6e9136dc0] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp, totalSize=27.1 K 2023-11-18 00:55:59,775 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting f3b36ab81c5d42ee9bfa14c0446191ad, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268951514 2023-11-18 00:55:59,775 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 8f61453b573745c5ad4b5b5663bed159, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268952604 2023-11-18 00:55:59,775 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 8d860904a15748f79776e230946a817a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268954478 2023-11-18 00:55:59,776 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting d3e8bb78d745444ea21e28d0b23676fc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268956355 2023-11-18 00:55:59,776 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 96b6a0d5683444bea3cf50e6e9136dc0, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:55:59,785 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): ef6b76369f80dbd561cdb4901f4e5351#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:56:00,223 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311181299906ea97943b4b18105e65e97de70_del 2023-11-18 00:56:00,223 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311181299906ea97943b4b18105e65e97de70_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311181299906ea97943b4b18105e65e97de70_del 2023-11-18 00:56:01,075 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad318e8b420844099fb9e3391c179663 2023-11-18 00:56:01,076 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family1/ad318e8b420844099fb9e3391c179663 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/ad318e8b420844099fb9e3391c179663 2023-11-18 00:56:01,110 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad318e8b420844099fb9e3391c179663 2023-11-18 00:56:01,111 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ef6b76369f80dbd561cdb4901f4e5351/family1 of ef6b76369f80dbd561cdb4901f4e5351 into ad318e8b420844099fb9e3391c179663(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:56:01,111 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:56:01,111 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:56:01,112 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): ef6b76369f80dbd561cdb4901f4e5351/family2 is initiating major compaction (all files) 2023-11-18 00:56:01,112 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:56:01,112 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:56:01,112 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of ef6b76369f80dbd561cdb4901f4e5351/family2 in testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:56:01,112 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/0eb2e3f8da9f414bb85dff27b3aee872, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/c7852d57875841229d0d37565020a8bf, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/6566e05acdd64e0e9f7b85ebbee03fae, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/a35f70f775c14129b413e044cc62b551, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/d1c5e514a719462fb214e97b203d1b89] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp, totalSize=25.4 K 2023-11-18 00:56:01,113 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 0eb2e3f8da9f414bb85dff27b3aee872, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268951514 2023-11-18 00:56:01,113 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting c7852d57875841229d0d37565020a8bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268952604 2023-11-18 00:56:01,114 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 6566e05acdd64e0e9f7b85ebbee03fae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268954478 2023-11-18 00:56:01,114 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting a35f70f775c14129b413e044cc62b551, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268956355 2023-11-18 00:56:01,114 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting d1c5e514a719462fb214e97b203d1b89, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:56:01,122 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): ef6b76369f80dbd561cdb4901f4e5351#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:56:01,130 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118b27962407ceb4089b8032b1b95d0deed_del 2023-11-18 00:56:01,130 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118b27962407ceb4089b8032b1b95d0deed_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231118b27962407ceb4089b8032b1b95d0deed_del 2023-11-18 00:56:01,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/f3b36ab81c5d42ee9bfa14c0446191ad, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8f61453b573745c5ad4b5b5663bed159, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8d860904a15748f79776e230946a817a, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d3e8bb78d745444ea21e28d0b23676fc, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/96b6a0d5683444bea3cf50e6e9136dc0] to archive 2023-11-18 00:56:01,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:01,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/f3b36ab81c5d42ee9bfa14c0446191ad to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/f3b36ab81c5d42ee9bfa14c0446191ad 2023-11-18 00:56:01,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8f61453b573745c5ad4b5b5663bed159 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8f61453b573745c5ad4b5b5663bed159 2023-11-18 00:56:01,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8d860904a15748f79776e230946a817a to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/8d860904a15748f79776e230946a817a 2023-11-18 00:56:01,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d3e8bb78d745444ea21e28d0b23676fc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d3e8bb78d745444ea21e28d0b23676fc 2023-11-18 00:56:01,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/96b6a0d5683444bea3cf50e6e9136dc0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/96b6a0d5683444bea3cf50e6e9136dc0 2023-11-18 00:56:01,551 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5994c240215641c59e63c04b5bc036ab 2023-11-18 00:56:01,551 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/.tmp/family2/5994c240215641c59e63c04b5bc036ab as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/5994c240215641c59e63c04b5bc036ab 2023-11-18 00:56:01,555 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5994c240215641c59e63c04b5bc036ab 2023-11-18 00:56:01,556 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ef6b76369f80dbd561cdb4901f4e5351/family2 of ef6b76369f80dbd561cdb4901f4e5351 into 5994c240215641c59e63c04b5bc036ab(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:56:01,556 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:56:01,556 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:56:01,556 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 445eac7d15f6befb858b73cb1ca55c8b/family1 is initiating major compaction (all files) 2023-11-18 00:56:01,557 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:56:01,557 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:56:01,559 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 445eac7d15f6befb858b73cb1ca55c8b/family1 in testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:56:01,559 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8643b058a8c2463da9ba86e017ad3719, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/35946be8d6cb4eebbe4330db808d85cd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/66b641f1ba094b4b960fc2e5c2afb3a7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/5255811ee6d74f4a93d862f07dd463fe, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/601c8aca0a464ca6b26ad97d7d6145a3] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp, totalSize=27.1 K 2023-11-18 00:56:01,559 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 8643b058a8c2463da9ba86e017ad3719, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268951513 2023-11-18 00:56:01,559 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 35946be8d6cb4eebbe4330db808d85cd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268952603 2023-11-18 00:56:01,560 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 66b641f1ba094b4b960fc2e5c2afb3a7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268954477 2023-11-18 00:56:01,560 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 5255811ee6d74f4a93d862f07dd463fe, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268956354 2023-11-18 00:56:01,560 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 601c8aca0a464ca6b26ad97d7d6145a3, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:56:01,568 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 445eac7d15f6befb858b73cb1ca55c8b#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:56:01,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/0eb2e3f8da9f414bb85dff27b3aee872, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/c7852d57875841229d0d37565020a8bf, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/6566e05acdd64e0e9f7b85ebbee03fae, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/a35f70f775c14129b413e044cc62b551, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/d1c5e514a719462fb214e97b203d1b89] to archive 2023-11-18 00:56:01,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:01,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/0eb2e3f8da9f414bb85dff27b3aee872 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/0eb2e3f8da9f414bb85dff27b3aee872 2023-11-18 00:56:01,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/c7852d57875841229d0d37565020a8bf to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/c7852d57875841229d0d37565020a8bf 2023-11-18 00:56:01,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/6566e05acdd64e0e9f7b85ebbee03fae to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/6566e05acdd64e0e9f7b85ebbee03fae 2023-11-18 00:56:01,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/a35f70f775c14129b413e044cc62b551 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/a35f70f775c14129b413e044cc62b551 2023-11-18 00:56:01,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/d1c5e514a719462fb214e97b203d1b89 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family2/d1c5e514a719462fb214e97b203d1b89 2023-11-18 00:56:02,006 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311187a8e94baed14449ca08ea8cdb2276c2e_del 2023-11-18 00:56:02,006 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311187a8e94baed14449ca08ea8cdb2276c2e_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311187a8e94baed14449ca08ea8cdb2276c2e_del 2023-11-18 00:56:02,860 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27423a562c2e4cc781fb0b822e02b4e7 2023-11-18 00:56:02,861 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family1/27423a562c2e4cc781fb0b822e02b4e7 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/27423a562c2e4cc781fb0b822e02b4e7 2023-11-18 00:56:02,882 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27423a562c2e4cc781fb0b822e02b4e7 2023-11-18 00:56:02,883 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 445eac7d15f6befb858b73cb1ca55c8b/family1 of 445eac7d15f6befb858b73cb1ca55c8b into 27423a562c2e4cc781fb0b822e02b4e7(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:56:02,884 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:56:02,884 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:56:02,884 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 445eac7d15f6befb858b73cb1ca55c8b/family2 is initiating major compaction (all files) 2023-11-18 00:56:02,884 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:56:02,884 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:56:02,884 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 445eac7d15f6befb858b73cb1ca55c8b/family2 in testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:56:02,884 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/d3bdc39417f54a98b1d96138dca12715, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/355a35cbb7de4c0d86198ea807436e53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/ec9c3322dcbf4d188b0fe060cbe386ef, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/53b0d54c852c410e9ee0c45a2343977f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/898bad99e0c6455cb02b3e8758b43ffc] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp, totalSize=25.4 K 2023-11-18 00:56:02,884 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting d3bdc39417f54a98b1d96138dca12715, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268951513 2023-11-18 00:56:02,885 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 355a35cbb7de4c0d86198ea807436e53, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268952603 2023-11-18 00:56:02,885 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting ec9c3322dcbf4d188b0fe060cbe386ef, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268954477 2023-11-18 00:56:02,885 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 53b0d54c852c410e9ee0c45a2343977f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268956354 2023-11-18 00:56:02,886 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 898bad99e0c6455cb02b3e8758b43ffc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:56:02,893 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 445eac7d15f6befb858b73cb1ca55c8b#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:56:02,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8643b058a8c2463da9ba86e017ad3719, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/35946be8d6cb4eebbe4330db808d85cd, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/66b641f1ba094b4b960fc2e5c2afb3a7, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/5255811ee6d74f4a93d862f07dd463fe, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/601c8aca0a464ca6b26ad97d7d6145a3] to archive 2023-11-18 00:56:02,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:02,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8643b058a8c2463da9ba86e017ad3719 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8643b058a8c2463da9ba86e017ad3719 2023-11-18 00:56:02,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/35946be8d6cb4eebbe4330db808d85cd to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/35946be8d6cb4eebbe4330db808d85cd 2023-11-18 00:56:02,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/66b641f1ba094b4b960fc2e5c2afb3a7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/66b641f1ba094b4b960fc2e5c2afb3a7 2023-11-18 00:56:02,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/5255811ee6d74f4a93d862f07dd463fe to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/5255811ee6d74f4a93d862f07dd463fe 2023-11-18 00:56:02,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/601c8aca0a464ca6b26ad97d7d6145a3 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/601c8aca0a464ca6b26ad97d7d6145a3 2023-11-18 00:56:03,300 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118a13a1836b9454a70af1a7bbe3e7dba56_del 2023-11-18 00:56:03,300 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118a13a1836b9454a70af1a7bbe3e7dba56_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231118a13a1836b9454a70af1a7bbe3e7dba56_del 2023-11-18 00:56:04,117 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfe3a4081c9645788981ac1d1d289af1 2023-11-18 00:56:04,117 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/.tmp/family2/bfe3a4081c9645788981ac1d1d289af1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/bfe3a4081c9645788981ac1d1d289af1 2023-11-18 00:56:04,121 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfe3a4081c9645788981ac1d1d289af1 2023-11-18 00:56:04,122 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 445eac7d15f6befb858b73cb1ca55c8b/family2 of 445eac7d15f6befb858b73cb1ca55c8b into bfe3a4081c9645788981ac1d1d289af1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:56:04,122 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:56:04,122 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:56:04,122 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 2105a8fa00c9746db00d3c0a044ab1d0/family1 is initiating major compaction (all files) 2023-11-18 00:56:04,122 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:56:04,122 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:56:04,123 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 2105a8fa00c9746db00d3c0a044ab1d0/family1 in testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:56:04,123 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/716667f021c84d73a160c2b096601759, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/53b26593814d44ec93bd1f3b297d36ed, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/f20cbab59f0140a7ad5160ca710a43b5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/2ad90eee1bc34bb89cbdb5c97e14f34d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/1391e07d5a4e4977b48d1b01fcb94f25] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp, totalSize=27.1 K 2023-11-18 00:56:04,124 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 716667f021c84d73a160c2b096601759, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268951514 2023-11-18 00:56:04,124 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 53b26593814d44ec93bd1f3b297d36ed, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268952604 2023-11-18 00:56:04,124 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting f20cbab59f0140a7ad5160ca710a43b5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268954478 2023-11-18 00:56:04,125 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 2ad90eee1bc34bb89cbdb5c97e14f34d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268956354 2023-11-18 00:56:04,125 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 1391e07d5a4e4977b48d1b01fcb94f25, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:56:04,133 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 2105a8fa00c9746db00d3c0a044ab1d0#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:56:04,169 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311182a078090970540d9bdb5cabed0545063_del 2023-11-18 00:56:04,169 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311182a078090970540d9bdb5cabed0545063_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311182a078090970540d9bdb5cabed0545063_del 2023-11-18 00:56:04,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/d3bdc39417f54a98b1d96138dca12715, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/355a35cbb7de4c0d86198ea807436e53, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/ec9c3322dcbf4d188b0fe060cbe386ef, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/53b0d54c852c410e9ee0c45a2343977f, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/898bad99e0c6455cb02b3e8758b43ffc] to archive 2023-11-18 00:56:04,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:04,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/d3bdc39417f54a98b1d96138dca12715 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/d3bdc39417f54a98b1d96138dca12715 2023-11-18 00:56:04,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/355a35cbb7de4c0d86198ea807436e53 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/355a35cbb7de4c0d86198ea807436e53 2023-11-18 00:56:04,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/ec9c3322dcbf4d188b0fe060cbe386ef to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/ec9c3322dcbf4d188b0fe060cbe386ef 2023-11-18 00:56:04,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/53b0d54c852c410e9ee0c45a2343977f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/53b0d54c852c410e9ee0c45a2343977f 2023-11-18 00:56:04,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/898bad99e0c6455cb02b3e8758b43ffc to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family2/898bad99e0c6455cb02b3e8758b43ffc 2023-11-18 00:56:05,028 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5dcabb3f5b8c4c42b2da975135c9bb5e 2023-11-18 00:56:05,029 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family1/5dcabb3f5b8c4c42b2da975135c9bb5e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/5dcabb3f5b8c4c42b2da975135c9bb5e 2023-11-18 00:56:05,050 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5dcabb3f5b8c4c42b2da975135c9bb5e 2023-11-18 00:56:05,051 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2105a8fa00c9746db00d3c0a044ab1d0/family1 of 2105a8fa00c9746db00d3c0a044ab1d0 into 5dcabb3f5b8c4c42b2da975135c9bb5e(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 00:56:05,051 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:56:05,051 DEBUG [Listener at localhost/41175] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 00:56:05,052 DEBUG [Listener at localhost/41175] regionserver.HStore(1912): 2105a8fa00c9746db00d3c0a044ab1d0/family2 is initiating major compaction (all files) 2023-11-18 00:56:05,052 INFO [Listener at localhost/41175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 00:56:05,052 INFO [Listener at localhost/41175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 00:56:05,052 INFO [Listener at localhost/41175] regionserver.HRegion(2259): Starting compaction of 2105a8fa00c9746db00d3c0a044ab1d0/family2 in testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:56:05,052 INFO [Listener at localhost/41175] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/460f9e615aa045579ca57085d4e51c95, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/e7ae665b946c42c3a78d642b71483bb3, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/39ec4f7b40614e7ebe218d4e69bc2afe, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/506b2dd6ed094f68864789d8bc111067, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/005709d5d9be4f8db68a34d608226765] into tmpdir=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp, totalSize=25.4 K 2023-11-18 00:56:05,052 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 460f9e615aa045579ca57085d4e51c95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700268951514 2023-11-18 00:56:05,053 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting e7ae665b946c42c3a78d642b71483bb3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700268952604 2023-11-18 00:56:05,053 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 39ec4f7b40614e7ebe218d4e69bc2afe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700268954478 2023-11-18 00:56:05,053 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 506b2dd6ed094f68864789d8bc111067, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700268956354 2023-11-18 00:56:05,054 DEBUG [Listener at localhost/41175] compactions.Compactor(207): Compacting 005709d5d9be4f8db68a34d608226765, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 00:56:05,062 INFO [Listener at localhost/41175] throttle.PressureAwareThroughputController(145): 2105a8fa00c9746db00d3c0a044ab1d0#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 00:56:05,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/716667f021c84d73a160c2b096601759, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/53b26593814d44ec93bd1f3b297d36ed, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/f20cbab59f0140a7ad5160ca710a43b5, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/2ad90eee1bc34bb89cbdb5c97e14f34d, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/1391e07d5a4e4977b48d1b01fcb94f25] to archive 2023-11-18 00:56:05,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:05,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/716667f021c84d73a160c2b096601759 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/716667f021c84d73a160c2b096601759 2023-11-18 00:56:05,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/53b26593814d44ec93bd1f3b297d36ed to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/53b26593814d44ec93bd1f3b297d36ed 2023-11-18 00:56:05,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/f20cbab59f0140a7ad5160ca710a43b5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/f20cbab59f0140a7ad5160ca710a43b5 2023-11-18 00:56:05,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/2ad90eee1bc34bb89cbdb5c97e14f34d to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/2ad90eee1bc34bb89cbdb5c97e14f34d 2023-11-18 00:56:05,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/1391e07d5a4e4977b48d1b01fcb94f25 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/1391e07d5a4e4977b48d1b01fcb94f25 2023-11-18 00:56:05,469 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111801902ba41e8244f3854e4b23e0df2558_del 2023-11-18 00:56:05,469 INFO [Listener at localhost/41175] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111801902ba41e8244f3854e4b23e0df2558_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111801902ba41e8244f3854e4b23e0df2558_del 2023-11-18 00:56:05,874 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-18 00:56:06,282 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47548d413e5a40ad82569deb4eaf0049 2023-11-18 00:56:06,282 DEBUG [Listener at localhost/41175] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/.tmp/family2/47548d413e5a40ad82569deb4eaf0049 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/47548d413e5a40ad82569deb4eaf0049 2023-11-18 00:56:06,286 INFO [Listener at localhost/41175] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47548d413e5a40ad82569deb4eaf0049 2023-11-18 00:56:06,287 INFO [Listener at localhost/41175] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2105a8fa00c9746db00d3c0a044ab1d0/family2 of 2105a8fa00c9746db00d3c0a044ab1d0 into 47548d413e5a40ad82569deb4eaf0049(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 00:56:06,287 DEBUG [Listener at localhost/41175] regionserver.HRegion(2289): Compaction status journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:56:06,290 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:56:06,293 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:56:06,297 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:56:06,298 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:56:06,303 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xDE,X\xD7\xAB!?\xD5b\x05>\x01\xD6\xFC\xFC"\x10Ml\xF9\xC3\x1E\xB5\xCD\x8FU>\xA9\xBFH?\x12\x97*\x10\xC7\xC8\x138d\x09\x1F\xF1TS\x5C\x9E9\x81\xF2I2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-18 00:56:06,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-18 00:56:06,325 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-18 00:56:06,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:56:06,326 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700269566326 2023-11-18 00:56:06,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 00:56:06,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/460f9e615aa045579ca57085d4e51c95, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/e7ae665b946c42c3a78d642b71483bb3, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/39ec4f7b40614e7ebe218d4e69bc2afe, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/506b2dd6ed094f68864789d8bc111067, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/005709d5d9be4f8db68a34d608226765] to archive 2023-11-18 00:56:06,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:06,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/460f9e615aa045579ca57085d4e51c95 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/460f9e615aa045579ca57085d4e51c95 2023-11-18 00:56:06,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/e7ae665b946c42c3a78d642b71483bb3 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/e7ae665b946c42c3a78d642b71483bb3 2023-11-18 00:56:06,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/39ec4f7b40614e7ebe218d4e69bc2afe to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/39ec4f7b40614e7ebe218d4e69bc2afe 2023-11-18 00:56:06,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/506b2dd6ed094f68864789d8bc111067 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/506b2dd6ed094f68864789d8bc111067 2023-11-18 00:56:06,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/005709d5d9be4f8db68a34d608226765 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family2/005709d5d9be4f8db68a34d608226765 2023-11-18 00:56:06,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-18 00:56:06,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311187a8e94baed14449ca08ea8cdb2276c2e_del 2023-11-18 00:56:06,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311182a078090970540d9bdb5cabed0545063_del 2023-11-18 00:56:06,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311181299906ea97943b4b18105e65e97de70_del 2023-11-18 00:56:06,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 00:56:06,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] zookeeper.ReadOnlyZKClient(139): Connect 0x7c6be178 to 127.0.0.1:58527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 00:56:06,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f68a5d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 00:56:06,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 00:56:07,719 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311185d08236595c745a3af38b1753264487c to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311185d08236595c745a3af38b1753264487c 2023-11-18 00:56:07,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 00:56:07,731 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 00:56:07,733 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 00:56:07,741 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 00:56:07,742 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 00:56:07,771 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118/family1/28ce97f6870c424bb1e5b3e8de8581d9 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-18 00:56:07,772 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118/family1/28ce97f6870c424bb1e5b3e8de8581d9}] 2023-11-18 00:56:07,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118/family1/28ce97f6870c424bb1e5b3e8de8581d9 for inclusion in 445eac7d15f6befb858b73cb1ca55c8b/family1 2023-11-18 00:56:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-18 00:56:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first= last=1 2023-11-18 00:56:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:56:07,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118/family1/28ce97f6870c424bb1e5b3e8de8581d9 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__i1dcfrv6s5eeclr4141b91e8i6kque48njagpbquec1jik8fpssck609vmnpcl1h/family1/28ce97f6870c424bb1e5b3e8de8581d9 2023-11-18 00:56:07,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__i1dcfrv6s5eeclr4141b91e8i6kque48njagpbquec1jik8fpssck609vmnpcl1h/family1/28ce97f6870c424bb1e5b3e8de8581d9 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8e575347edf64d84afffd02e55ea1173_SeqId_28_ 2023-11-18 00:56:07,801 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__i1dcfrv6s5eeclr4141b91e8i6kque48njagpbquec1jik8fpssck609vmnpcl1h/family1/28ce97f6870c424bb1e5b3e8de8581d9 into 445eac7d15f6befb858b73cb1ca55c8b/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8e575347edf64d84afffd02e55ea1173_SeqId_28_ - updating store file list. 2023-11-18 00:56:07,823 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8e575347edf64d84afffd02e55ea1173_SeqId_28_ into 445eac7d15f6befb858b73cb1ca55c8b/family1 2023-11-18 00:56:07,823 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__i1dcfrv6s5eeclr4141b91e8i6kque48njagpbquec1jik8fpssck609vmnpcl1h/family1/28ce97f6870c424bb1e5b3e8de8581d9 into 445eac7d15f6befb858b73cb1ca55c8b/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/family1/8e575347edf64d84afffd02e55ea1173_SeqId_28_) 2023-11-18 00:56:07,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__i1dcfrv6s5eeclr4141b91e8i6kque48njagpbquec1jik8fpssck609vmnpcl1h/family1/28ce97f6870c424bb1e5b3e8de8581d9 2023-11-18 00:56:07,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 00:56:07,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:07,827 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311184ace1112673747f38e3fe0fe20727cb1 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311184ace1112673747f38e3fe0fe20727cb1 2023-11-18 00:56:07,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111859cb9ac50a6e4f668f6c9576888e4600 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111859cb9ac50a6e4f668f6c9576888e4600 2023-11-18 00:56:07,829 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118a40f4fd772a84b0285b2f11aafcaf5b2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118a40f4fd772a84b0285b2f11aafcaf5b2 2023-11-18 00:56:07,830 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ee8677ddb1d74973817312fab206dfe0 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ee8677ddb1d74973817312fab206dfe0 2023-11-18 00:56:07,830 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-18 00:56:07,830 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 00:56:07,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 00:56:07,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 00:56:08,791 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118952ba1057fdf4af4abaf3dc047748305 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118952ba1057fdf4af4abaf3dc047748305 2023-11-18 00:56:08,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 00:56:08,837 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-18 00:56:08,838 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5}] 2023-11-18 00:56:08,840 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5 for inclusion in ef6b76369f80dbd561cdb4901f4e5351/family1 2023-11-18 00:56:08,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-18 00:56:08,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 00:56:08,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:56:08,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__8f695asjtfg9uet3duo51qcn7db2c180m7ahon3npgfrjqatemd3tud8hc5ghedn/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5 2023-11-18 00:56:08,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__8f695asjtfg9uet3duo51qcn7db2c180m7ahon3npgfrjqatemd3tud8hc5ghedn/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d328339b3d254946808893171c258a64_SeqId_28_ 2023-11-18 00:56:08,865 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__8f695asjtfg9uet3duo51qcn7db2c180m7ahon3npgfrjqatemd3tud8hc5ghedn/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5 into ef6b76369f80dbd561cdb4901f4e5351/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d328339b3d254946808893171c258a64_SeqId_28_ - updating store file list. 2023-11-18 00:56:08,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d328339b3d254946808893171c258a64_SeqId_28_ into ef6b76369f80dbd561cdb4901f4e5351/family1 2023-11-18 00:56:08,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__8f695asjtfg9uet3duo51qcn7db2c180m7ahon3npgfrjqatemd3tud8hc5ghedn/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5 into ef6b76369f80dbd561cdb4901f4e5351/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/family1/d328339b3d254946808893171c258a64_SeqId_28_) 2023-11-18 00:56:08,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__8f695asjtfg9uet3duo51qcn7db2c180m7ahon3npgfrjqatemd3tud8hc5ghedn/family1/5e3a0dd2e0c74bc0852e1497f03ac3f5 2023-11-18 00:56:08,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 00:56:08,888 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:08,889 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311180a72210e4a764709a4a8f77fc842eca2 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311180a72210e4a764709a4a8f77fc842eca2 2023-11-18 00:56:08,890 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311183217b4f55de04c5581bad1bb168aa296 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311183217b4f55de04c5581bad1bb168aa296 2023-11-18 00:56:08,891 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311188871f0891c7b4bd995eb803bb4d2c39f to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311188871f0891c7b4bd995eb803bb4d2c39f 2023-11-18 00:56:08,892 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111895999371f29c4dff97526d13292e6a38 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111895999371f29c4dff97526d13292e6a38 2023-11-18 00:56:08,892 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-18 00:56:08,892 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 00:56:08,893 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 00:56:08,893 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 00:56:09,848 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118e671d1f456b04b8ab709df5aa598e2b8 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118e671d1f456b04b8ab709df5aa598e2b8 2023-11-18 00:56:09,849 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 00:56:09,910 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118/family1/64d366a6e06648278657a44fe5e64f31 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-18 00:56:09,911 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0., hostname=jenkins-hbase4.apache.org,46287,1700268799711, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118/family1/64d366a6e06648278657a44fe5e64f31}] 2023-11-18 00:56:09,914 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(763): Validating hfile at hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118/family1/64d366a6e06648278657a44fe5e64f31 for inclusion in 2105a8fa00c9746db00d3c0a044ab1d0/family1 2023-11-18 00:56:09,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-18 00:56:09,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-18 00:56:09,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegion(2446): Flush status journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:56:09,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118/family1/64d366a6e06648278657a44fe5e64f31 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__u086m6qsji536qoc7khk17vqgeb21atfovcu2i5gg7mgv76pavpi6t85mnl0g3d1/family1/64d366a6e06648278657a44fe5e64f31 2023-11-18 00:56:09,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__u086m6qsji536qoc7khk17vqgeb21atfovcu2i5gg7mgv76pavpi6t85mnl0g3d1/family1/64d366a6e06648278657a44fe5e64f31 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/778aa54757fe4c959de190dec9efe7b7_SeqId_28_ 2023-11-18 00:56:09,939 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(849): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__u086m6qsji536qoc7khk17vqgeb21atfovcu2i5gg7mgv76pavpi6t85mnl0g3d1/family1/64d366a6e06648278657a44fe5e64f31 into 2105a8fa00c9746db00d3c0a044ab1d0/family1 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/778aa54757fe4c959de190dec9efe7b7_SeqId_28_ - updating store file list. 2023-11-18 00:56:09,961 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(882): Loaded HFile hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/778aa54757fe4c959de190dec9efe7b7_SeqId_28_ into 2105a8fa00c9746db00d3c0a044ab1d0/family1 2023-11-18 00:56:09,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.HStore(855): Successfully loaded hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__u086m6qsji536qoc7khk17vqgeb21atfovcu2i5gg7mgv76pavpi6t85mnl0g3d1/family1/64d366a6e06648278657a44fe5e64f31 into 2105a8fa00c9746db00d3c0a044ab1d0/family1 (new location: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/family1/778aa54757fe4c959de190dec9efe7b7_SeqId_28_) 2023-11-18 00:56:09,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46287] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/staging/jenkins__testMajorCompactionFromAdmin__u086m6qsji536qoc7khk17vqgeb21atfovcu2i5gg7mgv76pavpi6t85mnl0g3d1/family1/64d366a6e06648278657a44fe5e64f31 2023-11-18 00:56:09,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 00:56:09,965 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:09,967 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311180581186e5f084393abb9932fe1cdefcf to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311180581186e5f084393abb9932fe1cdefcf 2023-11-18 00:56:09,968 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118150f08c9390847239f9ff4276062fa14 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118150f08c9390847239f9ff4276062fa14 2023-11-18 00:56:09,969 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311185b587c111f4448b7b0e524306c5c62a7 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311185b587c111f4448b7b0e524306c5c62a7 2023-11-18 00:56:09,970 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311187afe2fda7b9143b68a2932003a5791c5 to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311187afe2fda7b9143b68a2932003a5791c5 2023-11-18 00:56:09,970 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-18 00:56:09,970 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118' 2023-11-18 00:56:09,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 00:56:09,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 00:56:09,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 00:56:09,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311187a8e94baed14449ca08ea8cdb2276c2e_del] 2023-11-18 00:56:09,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:09,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311187a8e94baed14449ca08ea8cdb2276c2e_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311187a8e94baed14449ca08ea8cdb2276c2e_del 2023-11-18 00:56:09,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-18 00:56:09,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311182a078090970540d9bdb5cabed0545063_del] 2023-11-18 00:56:09,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:09,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311182a078090970540d9bdb5cabed0545063_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311182a078090970540d9bdb5cabed0545063_del 2023-11-18 00:56:09,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-18 00:56:09,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] compactions.PartitionedMobCompactor(367): [hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311181299906ea97943b4b18105e65e97de70_del] 2023-11-18 00:56:09,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 00:56:09,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311181299906ea97943b4b18105e65e97de70_del to hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311181299906ea97943b4b18105e65e97de70_del 2023-11-18 00:56:09,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-18 00:56:09,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700268803198] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 00:56:09,978 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-18 00:56:09,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.6540 sec 2023-11-18 00:56:10,000 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:56:10,002 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:56:10,005 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 00:56:10,005 DEBUG [Listener at localhost/41175] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 00:56:10,009 INFO [Listener at localhost/41175] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 00:56:10,056 INFO [Listener at localhost/41175] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 262), OpenFileDescriptor=657 (was 682), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=141 (was 137) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=9645 (was 9671) 2023-11-18 00:56:10,056 DEBUG [Listener at localhost/41175] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05ae2dad to 127.0.0.1:58527 2023-11-18 00:56:10,057 DEBUG [Listener at localhost/41175] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:56:10,057 INFO [Listener at localhost/41175] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-18 00:56:10,057 INFO [Listener at localhost/41175] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 00:56:10,057 DEBUG [Listener at localhost/41175] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2324da13 to 127.0.0.1:58527 2023-11-18 00:56:10,057 DEBUG [Listener at localhost/41175] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:56:10,057 DEBUG [Listener at localhost/41175] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-18 00:56:10,057 DEBUG [Listener at localhost/41175] util.JVMClusterUtil(257): Found active master hash=1677735039, stopped=false 2023-11-18 00:56:10,057 INFO [Listener at localhost/41175] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:56:10,060 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-18 00:56:10,060 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-18 00:56:10,060 INFO [Listener at localhost/41175] procedure2.ProcedureExecutor(628): Stopping 2023-11-18 00:56:10,060 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:56:10,060 DEBUG [Listener at localhost/41175] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x748154db to 127.0.0.1:58527 2023-11-18 00:56:10,060 DEBUG [Listener at localhost/41175] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:56:10,060 INFO [Listener at localhost/41175] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46287,1700268799711' ***** 2023-11-18 00:56:10,060 INFO [Listener at localhost/41175] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-18 00:56:10,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-18 00:56:10,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-18 00:56:10,061 INFO [RS:0;jenkins-hbase4:46287] regionserver.HeapMemoryManager(220): Stopping 2023-11-18 00:56:10,061 INFO [RS:0;jenkins-hbase4:46287] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-18 00:56:10,061 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-18 00:56:10,061 INFO [RS:0;jenkins-hbase4:46287] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-18 00:56:10,061 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 55540310ce3ac98ac0e635e984990268 2023-11-18 00:56:10,061 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 9112cf8e9b2718ac97b90a301e29ddd2 2023-11-18 00:56:10,061 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 7303eedc2c2e47c9b75c5b6fa37c67a7 2023-11-18 00:56:10,061 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 442deadaba9fce82374166dd2c4e6d7a 2023-11-18 00:56:10,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 55540310ce3ac98ac0e635e984990268, disabling compactions & flushes 2023-11-18 00:56:10,061 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for ef6b76369f80dbd561cdb4901f4e5351 2023-11-18 00:56:10,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 3f9ece8e09cf675d69ecc9cf7ad07ca0 2023-11-18 00:56:10,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for cfa25bcf33a8406213d9a872fe13b7d1 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for f1e151a6eb43f2e0c44c3327d04ea7ac 2023-11-18 00:56:10,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. after waiting 0 ms 2023-11-18 00:56:10,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 4c699eeeeaea417afe3f12a85af3bbd0 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 79a29bcf437c750e54c6d5f8e605ce5a 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 9ad934b32fe540cf4771712205d429e0 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 4a4768ae6fe039be8e8dbafffed156f9 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 18747091e256122119350ffc73c8cf88 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for d45a160b99171bc2adfe82921961420b 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 445eac7d15f6befb858b73cb1ca55c8b 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 02b1e7a1949f099eff40c89fdf701b6f 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 6051ecb83963c3bda946a4c00690ef12 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 2105a8fa00c9746db00d3c0a044ab1d0 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for d58ab55def45369c725fc2db46bed884 2023-11-18 00:56:10,062 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:56:10,062 DEBUG [RS:0;jenkins-hbase4:46287] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3605bbb4 to 127.0.0.1:58527 2023-11-18 00:56:10,062 DEBUG [RS:0;jenkins-hbase4:46287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:56:10,063 INFO [RS:0;jenkins-hbase4:46287] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-18 00:56:10,063 INFO [RS:0;jenkins-hbase4:46287] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-18 00:56:10,063 INFO [RS:0;jenkins-hbase4:46287] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-18 00:56:10,063 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-18 00:56:10,063 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-18 00:56:10,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-18 00:56:10,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-18 00:56:10,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-18 00:56:10,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-18 00:56:10,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-18 00:56:10,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-18 00:56:10,064 DEBUG [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1504): Waiting on 02b1e7a1949f099eff40c89fdf701b6f, 1588230740, 18747091e256122119350ffc73c8cf88, 2105a8fa00c9746db00d3c0a044ab1d0, 3f9ece8e09cf675d69ecc9cf7ad07ca0, 442deadaba9fce82374166dd2c4e6d7a, 445eac7d15f6befb858b73cb1ca55c8b, 4a4768ae6fe039be8e8dbafffed156f9, 4c699eeeeaea417afe3f12a85af3bbd0, 55540310ce3ac98ac0e635e984990268, 6051ecb83963c3bda946a4c00690ef12, 7303eedc2c2e47c9b75c5b6fa37c67a7, 79a29bcf437c750e54c6d5f8e605ce5a, 9112cf8e9b2718ac97b90a301e29ddd2, 9ad934b32fe540cf4771712205d429e0, cfa25bcf33a8406213d9a872fe13b7d1, d45a160b99171bc2adfe82921961420b, d58ab55def45369c725fc2db46bed884, ef6b76369f80dbd561cdb4901f4e5351, f1e151a6eb43f2e0c44c3327d04ea7ac, f60a03911e1e030bc0df0fdae03cbef3 2023-11-18 00:56:10,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithMonthlyPolicy/55540310ce3ac98ac0e635e984990268/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-18 00:56:10,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:56:10,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 55540310ce3ac98ac0e635e984990268: 2023-11-18 00:56:10,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1700268815526.55540310ce3ac98ac0e635e984990268. 2023-11-18 00:56:10,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9112cf8e9b2718ac97b90a301e29ddd2, disabling compactions & flushes 2023-11-18 00:56:10,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:56:10,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:56:10,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. after waiting 0 ms 2023-11-18 00:56:10,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:56:10,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/9112cf8e9b2718ac97b90a301e29ddd2/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-18 00:56:10,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:56:10,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9112cf8e9b2718ac97b90a301e29ddd2: 2023-11-18 00:56:10,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1700268840133.9112cf8e9b2718ac97b90a301e29ddd2. 2023-11-18 00:56:10,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7303eedc2c2e47c9b75c5b6fa37c67a7, disabling compactions & flushes 2023-11-18 00:56:10,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:56:10,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:56:10,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. after waiting 0 ms 2023-11-18 00:56:10,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:56:10,074 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/.tmp/info/ae5e090a1fc642d0aaa5bc80aee5394e 2023-11-18 00:56:10,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/7303eedc2c2e47c9b75c5b6fa37c67a7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-18 00:56:10,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:56:10,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7303eedc2c2e47c9b75c5b6fa37c67a7: 2023-11-18 00:56:10,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1700268892983.7303eedc2c2e47c9b75c5b6fa37c67a7. 2023-11-18 00:56:10,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 442deadaba9fce82374166dd2c4e6d7a, disabling compactions & flushes 2023-11-18 00:56:10,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:56:10,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:56:10,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. after waiting 0 ms 2023-11-18 00:56:10,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:56:10,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae5e090a1fc642d0aaa5bc80aee5394e 2023-11-18 00:56:10,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/442deadaba9fce82374166dd2c4e6d7a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-18 00:56:10,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:56:10,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 442deadaba9fce82374166dd2c4e6d7a: 2023-11-18 00:56:10,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1700268892983.442deadaba9fce82374166dd2c4e6d7a. 2023-11-18 00:56:10,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef6b76369f80dbd561cdb4901f4e5351, disabling compactions & flushes 2023-11-18 00:56:10,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:56:10,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:56:10,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. after waiting 0 ms 2023-11-18 00:56:10,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:56:10,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/ef6b76369f80dbd561cdb4901f4e5351/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 00:56:10,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:56:10,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef6b76369f80dbd561cdb4901f4e5351: 2023-11-18 00:56:10,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1700268949369.ef6b76369f80dbd561cdb4901f4e5351. 2023-11-18 00:56:10,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3f9ece8e09cf675d69ecc9cf7ad07ca0, disabling compactions & flushes 2023-11-18 00:56:10,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:56:10,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:56:10,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. after waiting 0 ms 2023-11-18 00:56:10,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:56:10,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/.tmp/rep_barrier/a5650cfbc3fd43f092575e2adc978332 2023-11-18 00:56:10,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/3f9ece8e09cf675d69ecc9cf7ad07ca0/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-18 00:56:10,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:56:10,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3f9ece8e09cf675d69ecc9cf7ad07ca0: 2023-11-18 00:56:10,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1700268840133.3f9ece8e09cf675d69ecc9cf7ad07ca0. 2023-11-18 00:56:10,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cfa25bcf33a8406213d9a872fe13b7d1, disabling compactions & flushes 2023-11-18 00:56:10,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:56:10,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:56:10,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. after waiting 0 ms 2023-11-18 00:56:10,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:56:10,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5650cfbc3fd43f092575e2adc978332 2023-11-18 00:56:10,090 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-18 00:56:10,090 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-18 00:56:10,090 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-18 00:56:10,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testCompactionWithHFileLink/cfa25bcf33a8406213d9a872fe13b7d1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-18 00:56:10,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:56:10,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cfa25bcf33a8406213d9a872fe13b7d1: 2023-11-18 00:56:10,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1700268892983.cfa25bcf33a8406213d9a872fe13b7d1. 2023-11-18 00:56:10,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1e151a6eb43f2e0c44c3327d04ea7ac, disabling compactions & flushes 2023-11-18 00:56:10,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:56:10,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:56:10,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. after waiting 0 ms 2023-11-18 00:56:10,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:56:10,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/.tmp/table/0d85c3be3c344313a03ad1aa501c29b9 2023-11-18 00:56:10,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/f1e151a6eb43f2e0c44c3327d04ea7ac/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 00:56:10,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:56:10,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1e151a6eb43f2e0c44c3327d04ea7ac: 2023-11-18 00:56:10,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1700268918069.f1e151a6eb43f2e0c44c3327d04ea7ac. 2023-11-18 00:56:10,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f60a03911e1e030bc0df0fdae03cbef3, disabling compactions & flushes 2023-11-18 00:56:10,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:56:10,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:56:10,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. after waiting 0 ms 2023-11-18 00:56:10,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:56:10,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/f60a03911e1e030bc0df0fdae03cbef3/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-18 00:56:10,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d85c3be3c344313a03ad1aa501c29b9 2023-11-18 00:56:10,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:56:10,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f60a03911e1e030bc0df0fdae03cbef3: 2023-11-18 00:56:10,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700268803402.f60a03911e1e030bc0df0fdae03cbef3. 2023-11-18 00:56:10,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c699eeeeaea417afe3f12a85af3bbd0, disabling compactions & flushes 2023-11-18 00:56:10,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:56:10,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:56:10,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. after waiting 0 ms 2023-11-18 00:56:10,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:56:10,101 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/.tmp/info/ae5e090a1fc642d0aaa5bc80aee5394e as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/info/ae5e090a1fc642d0aaa5bc80aee5394e 2023-11-18 00:56:10,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithWeeklyPolicy/4c699eeeeaea417afe3f12a85af3bbd0/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 00:56:10,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:56:10,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c699eeeeaea417afe3f12a85af3bbd0: 2023-11-18 00:56:10,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1700268827840.4c699eeeeaea417afe3f12a85af3bbd0. 2023-11-18 00:56:10,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79a29bcf437c750e54c6d5f8e605ce5a, disabling compactions & flushes 2023-11-18 00:56:10,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:56:10,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:56:10,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. after waiting 0 ms 2023-11-18 00:56:10,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:56:10,105 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae5e090a1fc642d0aaa5bc80aee5394e 2023-11-18 00:56:10,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/info/ae5e090a1fc642d0aaa5bc80aee5394e, entries=226, sequenceid=130, filesize=37.9 K 2023-11-18 00:56:10,106 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/.tmp/rep_barrier/a5650cfbc3fd43f092575e2adc978332 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/rep_barrier/a5650cfbc3fd43f092575e2adc978332 2023-11-18 00:56:10,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/79a29bcf437c750e54c6d5f8e605ce5a/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-18 00:56:10,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:56:10,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79a29bcf437c750e54c6d5f8e605ce5a: 2023-11-18 00:56:10,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700268856632.79a29bcf437c750e54c6d5f8e605ce5a. 2023-11-18 00:56:10,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9ad934b32fe540cf4771712205d429e0, disabling compactions & flushes 2023-11-18 00:56:10,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:56:10,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:56:10,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. after waiting 0 ms 2023-11-18 00:56:10,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:56:10,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5650cfbc3fd43f092575e2adc978332 2023-11-18 00:56:10,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/rep_barrier/a5650cfbc3fd43f092575e2adc978332, entries=1, sequenceid=130, filesize=5.0 K 2023-11-18 00:56:10,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/9ad934b32fe540cf4771712205d429e0/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 00:56:10,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:56:10,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9ad934b32fe540cf4771712205d429e0: 2023-11-18 00:56:10,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/.tmp/table/0d85c3be3c344313a03ad1aa501c29b9 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/table/0d85c3be3c344313a03ad1aa501c29b9 2023-11-18 00:56:10,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1700268918069.9ad934b32fe540cf4771712205d429e0. 2023-11-18 00:56:10,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a4768ae6fe039be8e8dbafffed156f9, disabling compactions & flushes 2023-11-18 00:56:10,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:56:10,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:56:10,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. after waiting 0 ms 2023-11-18 00:56:10,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:56:10,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/ns/testMinorCompaction/4a4768ae6fe039be8e8dbafffed156f9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 00:56:10,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:56:10,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a4768ae6fe039be8e8dbafffed156f9: 2023-11-18 00:56:10,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1700268918069.4a4768ae6fe039be8e8dbafffed156f9. 2023-11-18 00:56:10,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18747091e256122119350ffc73c8cf88, disabling compactions & flushes 2023-11-18 00:56:10,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:56:10,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:56:10,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. after waiting 0 ms 2023-11-18 00:56:10,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:56:10,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d85c3be3c344313a03ad1aa501c29b9 2023-11-18 00:56:10,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/table/0d85c3be3c344313a03ad1aa501c29b9, entries=27, sequenceid=130, filesize=6.6 K 2023-11-18 00:56:10,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=130, compaction requested=false 2023-11-18 00:56:10,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/18747091e256122119350ffc73c8cf88/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-18 00:56:10,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:56:10,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18747091e256122119350ffc73c8cf88: 2023-11-18 00:56:10,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700268872033.18747091e256122119350ffc73c8cf88. 2023-11-18 00:56:10,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d45a160b99171bc2adfe82921961420b, disabling compactions & flushes 2023-11-18 00:56:10,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:56:10,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:56:10,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. after waiting 0 ms 2023-11-18 00:56:10,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:56:10,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-18 00:56:10,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-18 00:56:10,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-18 00:56:10,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-18 00:56:10,121 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-18 00:56:10,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionWithWeeklyPolicy/d45a160b99171bc2adfe82921961420b/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 00:56:10,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:56:10,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d45a160b99171bc2adfe82921961420b: 2023-11-18 00:56:10,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1700268845172.d45a160b99171bc2adfe82921961420b. 2023-11-18 00:56:10,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 445eac7d15f6befb858b73cb1ca55c8b, disabling compactions & flushes 2023-11-18 00:56:10,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:56:10,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:56:10,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. after waiting 0 ms 2023-11-18 00:56:10,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:56:10,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/445eac7d15f6befb858b73cb1ca55c8b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 00:56:10,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:56:10,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 445eac7d15f6befb858b73cb1ca55c8b: 2023-11-18 00:56:10,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1700268949369.445eac7d15f6befb858b73cb1ca55c8b. 2023-11-18 00:56:10,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 02b1e7a1949f099eff40c89fdf701b6f, disabling compactions & flushes 2023-11-18 00:56:10,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:56:10,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:56:10,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. after waiting 0 ms 2023-11-18 00:56:10,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:56:10,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMinorCompactionWithMonthlyPolicy/02b1e7a1949f099eff40c89fdf701b6f/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-18 00:56:10,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:56:10,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 02b1e7a1949f099eff40c89fdf701b6f: 2023-11-18 00:56:10,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1700268936403.02b1e7a1949f099eff40c89fdf701b6f. 2023-11-18 00:56:10,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6051ecb83963c3bda946a4c00690ef12, disabling compactions & flushes 2023-11-18 00:56:10,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:56:10,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:56:10,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. after waiting 0 ms 2023-11-18 00:56:10,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:56:10,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testScannerOnBulkLoadRefHFiles/6051ecb83963c3bda946a4c00690ef12/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-18 00:56:10,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:56:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6051ecb83963c3bda946a4c00690ef12: 2023-11-18 00:56:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1700268840133.6051ecb83963c3bda946a4c00690ef12. 2023-11-18 00:56:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2105a8fa00c9746db00d3c0a044ab1d0, disabling compactions & flushes 2023-11-18 00:56:10,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:56:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:56:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. after waiting 0 ms 2023-11-18 00:56:10,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:56:10,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/default/testMajorCompactionFromAdmin/2105a8fa00c9746db00d3c0a044ab1d0/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 00:56:10,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:56:10,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2105a8fa00c9746db00d3c0a044ab1d0: 2023-11-18 00:56:10,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1700268949369.2105a8fa00c9746db00d3c0a044ab1d0. 2023-11-18 00:56:10,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d58ab55def45369c725fc2db46bed884, disabling compactions & flushes 2023-11-18 00:56:10,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:56:10,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:56:10,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. after waiting 0 ms 2023-11-18 00:56:10,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:56:10,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d58ab55def45369c725fc2db46bed884 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-18 00:56:10,139 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-18 00:56:10,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884/.tmp/info/6262a9b69a8c4347a99075dc64b15c60 2023-11-18 00:56:10,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884/.tmp/info/6262a9b69a8c4347a99075dc64b15c60 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884/info/6262a9b69a8c4347a99075dc64b15c60 2023-11-18 00:56:10,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884/info/6262a9b69a8c4347a99075dc64b15c60, entries=3, sequenceid=7, filesize=4.8 K 2023-11-18 00:56:10,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d58ab55def45369c725fc2db46bed884 in 15ms, sequenceid=7, compaction requested=false 2023-11-18 00:56:10,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/data/hbase/namespace/d58ab55def45369c725fc2db46bed884/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-18 00:56:10,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:56:10,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d58ab55def45369c725fc2db46bed884: 2023-11-18 00:56:10,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1700268801675.d58ab55def45369c725fc2db46bed884. 2023-11-18 00:56:10,264 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46287,1700268799711; all regions closed. 2023-11-18 00:56:10,272 DEBUG [RS:0;jenkins-hbase4:46287] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/oldWALs 2023-11-18 00:56:10,272 INFO [RS:0;jenkins-hbase4:46287] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46287%2C1700268799711.meta:.meta(num 1700268801358) 2023-11-18 00:56:10,276 DEBUG [RS:0;jenkins-hbase4:46287] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/oldWALs 2023-11-18 00:56:10,276 INFO [RS:0;jenkins-hbase4:46287] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46287%2C1700268799711:(num 1700268801184) 2023-11-18 00:56:10,276 DEBUG [RS:0;jenkins-hbase4:46287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:56:10,276 INFO [RS:0;jenkins-hbase4:46287] regionserver.LeaseManager(133): Closed leases 2023-11-18 00:56:10,276 INFO [RS:0;jenkins-hbase4:46287] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-18 00:56:10,276 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-18 00:56:10,277 INFO [RS:0;jenkins-hbase4:46287] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46287 2023-11-18 00:56:10,285 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46287,1700268799711 2023-11-18 00:56:10,285 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-18 00:56:10,285 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-18 00:56:10,287 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46287,1700268799711] 2023-11-18 00:56:10,288 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46287,1700268799711; numProcessing=1 2023-11-18 00:56:10,289 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46287,1700268799711 already deleted, retry=false 2023-11-18 00:56:10,289 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,46287,1700268799711 expired; onlineServers=0 2023-11-18 00:56:10,289 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38477,1700268798477' ***** 2023-11-18 00:56:10,289 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-18 00:56:10,290 DEBUG [M:0;jenkins-hbase4:38477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@253d3e44, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-18 00:56:10,290 INFO [M:0;jenkins-hbase4:38477] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38477,1700268798477 2023-11-18 00:56:10,290 INFO [M:0;jenkins-hbase4:38477] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38477,1700268798477; all regions closed. 2023-11-18 00:56:10,290 DEBUG [M:0;jenkins-hbase4:38477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 00:56:10,290 DEBUG [M:0;jenkins-hbase4:38477] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-18 00:56:10,290 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-18 00:56:10,290 DEBUG [M:0;jenkins-hbase4:38477] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-18 00:56:10,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700268800852] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700268800852,5,FailOnTimeoutGroup] 2023-11-18 00:56:10,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700268800852] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700268800852,5,FailOnTimeoutGroup] 2023-11-18 00:56:10,290 INFO [M:0;jenkins-hbase4:38477] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-18 00:56:10,290 INFO [M:0;jenkins-hbase4:38477] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-18 00:56:10,290 INFO [M:0;jenkins-hbase4:38477] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-18 00:56:10,291 DEBUG [M:0;jenkins-hbase4:38477] master.HMaster(1512): Stopping service threads 2023-11-18 00:56:10,291 INFO [M:0;jenkins-hbase4:38477] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-18 00:56:10,291 ERROR [M:0;jenkins-hbase4:38477] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-18 00:56:10,291 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-18 00:56:10,291 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 00:56:10,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-18 00:56:10,292 INFO [M:0;jenkins-hbase4:38477] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-18 00:56:10,292 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-18 00:56:10,292 DEBUG [M:0;jenkins-hbase4:38477] zookeeper.ZKUtil(398): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-18 00:56:10,292 WARN [M:0;jenkins-hbase4:38477] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-18 00:56:10,292 INFO [M:0;jenkins-hbase4:38477] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-18 00:56:10,292 INFO [M:0;jenkins-hbase4:38477] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-18 00:56:10,293 DEBUG [M:0;jenkins-hbase4:38477] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-18 00:56:10,293 INFO [M:0;jenkins-hbase4:38477] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 00:56:10,293 DEBUG [M:0;jenkins-hbase4:38477] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 00:56:10,293 DEBUG [M:0;jenkins-hbase4:38477] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-18 00:56:10,293 DEBUG [M:0;jenkins-hbase4:38477] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 00:56:10,293 INFO [M:0;jenkins-hbase4:38477] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.96 KB heapSize=599.19 KB 2023-11-18 00:56:10,387 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-18 00:56:10,387 INFO [RS:0;jenkins-hbase4:46287] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46287,1700268799711; zookeeper connection closed. 2023-11-18 00:56:10,388 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x101f6aa264f0001, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-18 00:56:10,388 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2e4c055e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2e4c055e 2023-11-18 00:56:10,388 INFO [Listener at localhost/41175] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-18 00:56:10,700 INFO [M:0;jenkins-hbase4:38477] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.96 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/aa86ed5980e8486797068a18cd2c1a36 2023-11-18 00:56:10,704 INFO [M:0;jenkins-hbase4:38477] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa86ed5980e8486797068a18cd2c1a36 2023-11-18 00:56:10,705 DEBUG [M:0;jenkins-hbase4:38477] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/aa86ed5980e8486797068a18cd2c1a36 as hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/aa86ed5980e8486797068a18cd2c1a36 2023-11-18 00:56:10,707 INFO [M:0;jenkins-hbase4:38477] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa86ed5980e8486797068a18cd2c1a36 2023-11-18 00:56:10,708 INFO [M:0;jenkins-hbase4:38477] regionserver.HStore(1080): Added hdfs://localhost:40865/user/jenkins/test-data/62bdc34e-596b-e015-f71d-1f884f92dbab/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/aa86ed5980e8486797068a18cd2c1a36, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-18 00:56:10,708 INFO [M:0;jenkins-hbase4:38477] regionserver.HRegion(2948): Finished flush of dataSize ~512.96 KB/525269, heapSize ~599.17 KB/613552, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1011, compaction requested=false 2023-11-18 00:56:10,709 INFO [M:0;jenkins-hbase4:38477] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 00:56:10,709 DEBUG [M:0;jenkins-hbase4:38477] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-18 00:56:10,712 INFO [M:0;jenkins-hbase4:38477] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-18 00:56:10,712 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-18 00:56:10,712 INFO [M:0;jenkins-hbase4:38477] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38477 2023-11-18 00:56:10,715 DEBUG [M:0;jenkins-hbase4:38477] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38477,1700268798477 already deleted, retry=false 2023-11-18 00:56:10,818 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-18 00:56:10,818 DEBUG [Listener at localhost/41175-EventThread] zookeeper.ZKWatcher(600): master:38477-0x101f6aa264f0000, quorum=127.0.0.1:58527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-18 00:56:10,818 INFO [M:0;jenkins-hbase4:38477] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38477,1700268798477; zookeeper connection closed. 2023-11-18 00:56:10,820 WARN [Listener at localhost/41175] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-18 00:56:10,823 INFO [Listener at localhost/41175] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-18 00:56:10,931 WARN [BP-301733932-172.31.14.131-1700268795059 heartbeating to localhost/127.0.0.1:40865] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-18 00:56:10,931 WARN [BP-301733932-172.31.14.131-1700268795059 heartbeating to localhost/127.0.0.1:40865] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-301733932-172.31.14.131-1700268795059 (Datanode Uuid d1b3c53f-7c3b-4aa8-a0d5-78d0e40801bb) service to localhost/127.0.0.1:40865 2023-11-18 00:56:10,933 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/cluster_8c545dd1-5e13-fa17-ac7b-07a423d1c876/dfs/data/data1/current/BP-301733932-172.31.14.131-1700268795059] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-18 00:56:10,933 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/adb283d3-2db5-27e9-005b-9bc8dd681371/cluster_8c545dd1-5e13-fa17-ac7b-07a423d1c876/dfs/data/data2/current/BP-301733932-172.31.14.131-1700268795059] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-18 00:56:10,958 INFO [Listener at localhost/41175] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-18 00:56:11,091 INFO [Listener at localhost/41175] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-18 00:56:11,172 INFO [Listener at localhost/41175] hbase.HBaseTestingUtility(1293): Minicluster is down